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The  testing  of  variance  components  in  the  case  of  unbalanced 
designs  has  relied  on  approximate  techniques,  particularly  on 
Satterthwaite's  approximation  of  the  test  statistic.   While  this 
procedure  has  performed  well  witl^  some  unbalanced  designs,  it  has 
performed  poorly  in  many  others.   Furthermore,  the  exact  distribu- 
tions of  the  approximate  test  statistics  are  unknown  under  both 
the  null  and  alternative  hypotheses.   Hence,  the  appeal  for  exact 
testing  techniques  is  understandable. 

The  problem  of  deriving  exact  tests  for  variance  components 
in  two  unbalanced  random-effects  models  has  been  solved  in  the 
special  cases  of  the  2-fold  nested  and  two-way  cross 
classification  models.   Other  exact  tests  have  been  proposed  in 
the  past  for  these  random  models,  but  with  questionable 
assumptions. 
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Only  two  articles  have  explored  the  problem  of  the  unbalanced 
mixed  model  is  involved.   Furthermore,  their  presentation  leaves 
the  problem  of  testing  the  fixed  effects  unanswered. 

I  present  exact  tests  for  testing  the  variance  components  and 
for  testing  the  fixed  effects  in  unbalanced  2-fold  nested  and  two- 
way  cross  classification  mixed  models.   In  addition,  I  consider  a 
conservative  test  for  the  variance  component  of  the  nesting  effect 
in  a  random  2-fold  nested  model. 

The  exact  tests  are  compared  to  Sat terthwaite 's  approximate 
tests,  with  respect  to  power,  using  designs  with  different  degrees 
of  imbalance. 


CHAPTER   ONE 
INTRODUCTION 

The  technique  that  we  will  illustrate  is  based  on  obtaining  a 
randora  vector  having  a  diagonal  variance-covariance  matrix.   Once 
we  obtain  this  vector  we  transform  the  model  into  a  fixed-effects 
model  and  apply  the  theory  of  least  squares.   The  2-fold  nested 
mixed  model  will  be  used  to  outline  the  derivations  involved, 
followed  by  a  brief  discussion  of  the  mixed  two-way  cross 
classification  model. 

Consider  the  2-fold  nested  mixed  model, 

y...  =p+a.+b.,,.+e.; 
ijk        1    j(i)     ijk 

i=l,2,...,a;  j=l,2,...,m.;  k=l , 2 , . . . ,n^ ^ . ^ ,    (1.1) 

where  y  is  an  unknown  constant;  a.  is  a  fixed  unknown  parameter; 
b./^-v  and  e^.,  are  independently  distributed  as  N(0,o^)  and 
N(0,a2),  respectively.   The  objective  is  to  derive  an  exact  test 
statistic  for  testing  estimable  linear  functions  of  the  fixed 
effects , 

H  :  R'[y  :  a^l'  =  m,  (1.2) 
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where  a  =  (a,,  ...,  ci  )';  R  is  a  matrix  of  full  row  rank  of 
independent  estimable  linear  functions  of  a  and  ra  is  a  vector  of 
known  constants.   We  begin  by  considering  the  residual  sum  of 
squares  of  the  model,  that  is, 


0  =  I  (y...  -  y..  Y,  (1-3) 

e    .^,  ^  ijk    11*  ^ 
ijk 


which  we  can  express  in  matrix  form  as 


Q,  =  m^  (1-^) 


by  using  V/  =  { I    -  ^  fj     /n.  ,  .  ,  1 }  (®  is  the  direct  sum 

operator)  and  y  is  the  vector  of  observations.   Now,  the  matrix  M 

a 
is  an  idempotent  matrix  of  rank  equal  to  n, ,  -  m,  (m,  =     I      n.); 

i=l   ^ 
hence,  there  exists  an  orthogonal  matrix,  H,  such  that 


W  =  HAH'  ,  (1.5) 

where  A  is  a  diagonal  matrix  whose  diagonal  elements  are  the 

eigenvalues  of  W.  (Since  W  is  idempotent  its  eigenvalues  are  0  and 

1.)   Assuming  that  n, ,  >  2m,  and  by  noticing  the  form  of  W  in 
(1.4)  we  can  partition  H  and  A  into 


H  =      [H^  :  H^  :  H^J 


(1.6) 


A  =  Diag[l    :  I 


n   -  2m 
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where  H,,  H^,  }Io  are  matrices  of  orders  n,,  x  rn,  , 
n^^  X  (n,,  -  2iii,  ) ,  and  n, ,  x  ra,  ,  respectively; 
0  is  an  ta,  x  m,  matrix  of  zeroes. 

To  obtain  a  random  vector  having  a  diagonal  variance- 
covariance  matrix,  let  us  consider  the  vector  w  defined  as 


w  =  y  +  fA    I   -  k)  ^2h-;  V  ,  (1.7) 

~   '^    ^  max  ra     ^     1  -^ 

where  y  is  the  vector  of  cell  means,  y . ■   =  (l/n./.s)   )    y..,  ; 

K  =  Diag(n-J^^,  n'J^^,  ...,  n"^    ) ;  X^^^   is  the  largest 

a 
eigenvalue  of  K;  the  vector  ;(?  is  well-defined  and  has  a  mean 

vector  and  a  variance-covariance  matrix  given  by 


E(w)    =  ul   +  B.ci, 

Var(w)  =1  (al   +   \        a^' 
~     m  ^  b    max  e^ 


(1.8) 


where  B,  =   §   1   .    Now,  let 
1  =  1    1 


p   =  [u  :  a'j 


*  —  1/ 

e   =1   b  +  e  +  f  A    I   -   K.)    '^H'e, 
~     m  ~    ~    ^  max  m     ^     1 


(1.9) 


where  ^  =  (b^),  b^^^y    ...,  b^  .3). 
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Hence,  j^  can  be  written  as 

w  =  X£  +  £*  .  (1.10) 

This  model  has  a  residual  sum  of  squares  of 

SSE  =  w'  fl   -  X(X'X)"x')w,  (1.11) 

~    m  ~ 

vjhich    is    distributed    as    a     y^ 

m  -a 

To  obtain  a  test  statistic  that  can  be  used  to  test  the 
hypothesis  (1.2),  consider  the  quadratic  forni 


(M)      r  ^-l     *2 

a     ~a^    X  ^   ~a 


x2[s,(R'£-in)"[R'G  r)  ^(  R'p-m) /2a''  ]         (1.12) 


where  I     =  R'p  -  m,  p   is  a  solution  to  the  normal  equations 
~a     ^   ~  ^ 

(X'X)p°=  X'w;  G  =  (X'X)  ;  a   =   al   +  \        a^ ;    s    =   rank(R').   The 
'^     ~   X  b    max  e 

quadratic  form  Q    and  SSE  (1.11)  are  independently 
distributed.   Hence  to  test  the  hypothesis  (1.2),  we  can  use  the 
following  test  statistic: 

^a   /^        r  -1  *2n 

F(H)  =  -^^^y^ :^  ~  F[s,(m  -a),(R"£-m)'(R'G  R)   (R'p-m)/2a   ]. 


(1.13) 


Note  that  under  H  :  R'p  =  m,  F(H)  has  a  central  F  distribution 
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with  s  and  m,-a  numerator  and  denominator  degrees  of  freedom, 
respectively.   Hence,  we  have  an  exact  test  for  the  fixed  effects. 

In  a  similar  fashion  an  exact  test  is  derived  for  the  fixed 
effects  in  a  two-way  cross  classification  mixed  model.   We  again 
attempt  to  arrive  at  a  random  vector,  as  in  (1.7);  however,  unlike 
the  2-fold  nested  mixed  model,  where  Var(^)  involves  only  diagonal 

_  0       0  -* 

matrices  [Var(_^)  =  1  <^i^  +  Ka^ ) ,  the  Var(^  )  (where  *  denotes  a 
two-way  cross  classification  model)  involves  matrices  which  are 
not  diagonal.   Rather, 

Var(v  )  =  A„ct2  +  I  a2   +  K  a^  ,  (1.14) 

■^      2  3     rs  a6      e 

where  A^  =  J  x  I   (x  is  the  direct  product  operator)  and 

*         —  1     —  1        —1 
K  =  Diagfn,,  ,n,„,  ...,  n   1.   Note  that  the  matrix  A„  is  not  a 
t.1.  11  '   12        rs  -^  - 

diagonal  matrix.   Furthermore,  note  that  in  model  (1.1),  we  have 
only  one  set  of  random  effects  aside  from  random  error;  hence, 
only  one  variance  component  exists  in  addition  to  the  variance 
component  associated  with  the  error;  whereas,  in  a  two-way  cross 
classification  mixed  model,  we  have  two  sets  of  random  effects — a 
random  effect  and  a  random  interaction  effect,  with  variance 
components  al    and  o^n,    respectively.   In  order  to  proceed  as 
above,  we  need  a  transformation  which  will  consequently  allow  us 
to  form  a  ratio  consisting  of  two  quadratic  forms,  depending  on 
the  same  set  of  variance  components,  with  the  denominator 
distributed  as  a  central  chi-square  under  both  the  null  and 
alternative  hypotheses. 
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Consider  the  two-way  cross  classification  mixed  model: 


y..,  =u+a.  +S.+a8..+e..,; 
ijk        1    J      ij     ijk 


i=l,2,...,r;  j=l,2,...,s;  k=l,2 n . ^ ,     (1.15) 


where  y  is  an  unknown  constant;  a.  is  an  unknown  fixed  parameter; 
6.,  (g(3)--,  and  e.-,  are  independently  distributed  as  N(0,ao), 

N(0,a2  ),  and  N(0,a|),  respectively. 

_* 

Define  y.  .   =  (1/n. .  )  Z  y.  .,  ,  so  that  in  matrix  notation 


y  =  U 1    +  B,a  +  B-6  +1  a6  +  e 
^     ~rs    1~    2~    rs     ~ 


(1.16) 


where  ct  =  (a,,  a„,  ...,  a  );  ^  =  (S,,  6„  ,  ...,  6  Y 
12      '^/o     1'2 


s 


a6  =  (a0,,,  ci3,„,  ...,  a3   )';  B,  =  I  x  i   and  B.  =  1  x  i  ; 
11     12         rs     i     r   ~s      2   -r    s 

e  ~  NfO,  K  a2]. 

Consider  the  matrices  A,  =  B,BT  and  A2  =  B2B2.   These 
matrices  commute,  hence,  there  exists  an  orthogonal  matrix  P  that 
simultaneously  diagonalizes  both  A,  and  A^ •   Let 


u  =  P;^*.  (1.17) 

As  we  will  see  in  Chapter  Three,  this  random  vector,  ja,  can  be 
partitioned  into 
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u^-N^(u(rs)  ^2  +  (rs)   ^2^^^B^a,ra2  +  a2g  +  (rs)  \l    n^J]a^ 

ij 


~2   r-1^  2  L~   aS  r-1     2    2  e^ 


(1.18) 


~3   s-l^~'    B    cxB   s-1    3   3  e^  ' 

■k 

~4   (r-l)(s-l)^~   aS   (r-l)(s-l)    4    4  e^ 

where  P^,  P-^,  P/  are  the  corresponding  submatrices  of  P  (see 
CHAPTER  THREE,  Section  3.4.2).   What  is  important  here  is  to  note 
that  the  variance-covariance  matrices  for  U2  and  ^/  depend  on  the 
same  set  of  variance  components;  hence,  we  can  consider 
concatenating  these  two  random  vectors  into 


i32:4  =  ^^2    '■    ^V' 


(1.19) 


From  the  residual  sum  of  squares  associated  with  the  model  we  can 
obtain  a  partition  similar  to  (1.6)  and  define  the  random  vector^ 


+  U     I  ,__  ,.  -  L^^J  ^2h^^^ 


'2:4    *■  max   s(r-l) 


where 


'2:4 


P2K  P2 


P^K  p; 


^,^   ^2  ^=^  n 


(1.20) 


A     Is  the  largest  eigenvalue  of  L^  ,;  Hr-i  is  derived  similarily 
max  '^  '^  / :  4'   Fl  ■' 

to  the  H,  matrix  in  (1.6);  y   is  the  vector  of  observations. 
Following  the  steps  in  (1.10),  (1.11),  and  (1.12)  we  derive  an 
exact  test  concerning  estimable  linear  functions  of  a  in  (1.16), 
similar  to  the  exact  test  derived  for  the  fixed  effects  in  the 
2-fold  nested  mixed  model  (see  (1.13)J. 

In  addition  to  the  tests  for  the  fixed  effects,  exact  tests 
are  derived  for  the  variance  components  associated  with  the  random 
effects  in  both  models  (1.1)  and  (1.15).   The  development  of  an 
exact  test  for  the  variance  component  associated  with  the  nested 
effect  in  the  2-fold  nested  model  essentially  involves  deriving  a 
random  vector  having  expectation  0.   This  involves  pre-multiplying 
the  vector  of  cell  means  by  a  matrix,  C,  whose  rows  define 
orthogonal  contrasts  so  that 

CE(^)  =  0  ,  (1.21) 

The  derivation  of  the  exact  tests  for  the  variance  components 
associated  with  the  random  effects  in  the  two-way  cross 
classification  mixed  model  involves  the  technique  outlined  above 
for  testing  the  fixed  effects. 


CHAPTER  TWO 
LITERATURE  REVIEW 


2. 1  Introduction 

As  articulated  in  Cummings  and  Gaylor  (1974),  the  testing  of 

variance  components  when  we  have  an  unbalanced  design,  in  general, 

cannot  employ  the  test  statistics  derived  for  the  analogous 

balanced  situation.   Consider  the  random-effects  2-fold  nested 

model  with  variance  components  a^  ,  a?,  and  a^  ,  associated  witli  the 
t-        a '   b '       e ' 

nesting,  nested,  and  error  factors,  respectively.   The  hypothesis 

H  :  T,  =  0  (where  x,  =  a^/a^)    can  be  tested  using  an  exact  test 
o   b  b    0   e'  ° 

based  on  the  ratio  of  the  mean  square  associated  with  the  nested 
effect  (MSB)  to  the  error  mean  square.   This  same  test  is  employed 
when  the  data  set  is  balanced.   On  the  other  hand,  we  know  that  in 
general,  in  an  unbalanced  data  situation  the  mean  square 
associated  with  the  nesting  effect  (MSa)  does  not  have  a  chi- 
square  type  distribution.   Furthermore,  this  mean  square  in 
general  is  not  independently  distributed  from  MSB.   Hence,  we 
cannot  employ  the  analogous  test  statistic  derived  for  balanced 
data  to  test  the  hypothesis  H^  :  t^  =  0  (where  t^  =  a^^/a^),    that 

*J  1      3  3.  3.         f^ 

is,  MSa/MSB.   Cummings  and  Gaylor  noted  that  the  expected  value  of 
MSa  and  MSB  are  not,  in  general,  equal  under  H   . 
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To  test  H   ,  Cummings  and  Gaylor  used  Satterthwaite 's  (1946) 
approximation.   They  derived  a  ratio  whose  denominator  is  a  linear 
combination  of  the  nested  and  error  mean  squares,  such  that,  its 
expected  value  is  equivalent  to  the  expected  value  of  MSa  under 
H  , .   Satterthwaite 's  approximation  requires  the  mean  squares 
involved  to  be  independently  distributed  with  chi-square  type 
distributions.   As  noted  above,  these  assumptions  may  be  violated 
when  we  have  unbalanced  data. 

Cummings  and  Gaylor  studied  the  effects  of  failures  of  these 
assumptions  under  Satterthwaite's  approximation.   They  found  that 
when  MSa  and  MS6  were  independently  distributed  but  did  not  have 
chi-square  type  distributions,  the  actual  test  size  was  equal  to 
the  stated  test  size  when  t,  =  0;  however,  the  computed  test  size 
was  increasingly  larger  than  the  stated  test  size  with  increasing 
values  of  i ^   due  to  the  increasing  nonchi-squaredness  of  MSa  and 
MSB.   When  they  considered  dependent  MSa's  and  MSB's  having  chi- 
square  type  distributions,  the  opposite  occurred,  namely,  with 
increasing  values  of  t>  ,  the  computed  test  size  was  increasingly 
smaller  than  the  stated  test  size,   l^en  both  violations  occur, 
that  is,  a  non-chi-squaredness  and  a  dependency  of  the  mean 
squares,  the  effects  appear  to  cancel  each  other  and  the  stated 
test  size  is  close  to  the  estimated  test  size. 

As  pointed  out  in  Tietjen  (1974),  there  are  conditions  for 
unbalanced  2-fold  nested  designs  where  the  assumptions  of  chi- 
square  and  independency  are  not  violated.   For  instance,  when  we 
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have  last-stage  uniformity,  that  is  n  =  n./.-v  '^.i .:  ,  MSa  and  MSS  are 

independent  and  distributed  as  scaled  chi-square  variates.   In 

addition,  E(ilSa)  and  E(MS6)  are  equal  under  H  ,  hence,  the 
conventional  F-test, 

F  =  MSa/MS3,  (2.1) 

provides  an  exact  test  for  testing  H   . 

In  the  following  section,  we  will  briefly  discuss  past  and 
recent  developments  concerning  the  exact  testing  of  variance 
components  when  we  have  unbalanced  data. 

2.2  Exact  Tests 


Harville  and  Fenech  (1985)  considered  the  derivation  of  an 
exact  confidence  Interval  for  the  ratio  of  the  variance  component 
associated  with  a  set  of  random  effects  and  the  variance  component 
associated  with  the  error.   The  derivation  is  based  on  an 
unbalanced  mixed  model  with  only  a  single  set  of  random  effects 
(an  extension  is  suggested  in  later  chapters  of  the  paper). 
Consider  the  mixed  model  (y  is  nxl  random  vector): 

^=Xa+Z8+e,  (2.2) 

where  a  is  a  pxl  vector  of  fixed  effects;  ^  and  £  are 
independently  distributed  random  vectors  of  orders  m  x  1  and  nx 1 , 
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respectively,  with  S  ~  MVNCO.a^l)  and  e  ~  :iVN(0,a|l); 

X  and  Z  are  given  matrices.   The  objective  is  to  derive  an  exact 

confidence  interval  for  Tg  =  ag/a„. 

Essentially,  Harville  and  Fenech  consider  treating  the 
effects  in  the  model  as  if  they  were  all  fixed.   They  arrive  at 
the  normal  equations: 


X' X     X' Z 


Z'X     Z'Z 


X'^ 
Z'^ 


(2.3) 


From  (2.3),  the  reduced  normal  equations  (see  Searle  (1971) 
p.  264)  are  obtained, 


SS  =  3. 


(2.4) 


where 


C^  =  Z'(l  -  X'(X-'X)  XJZ; 


5  =  Z'(I  -  X'(X'X)  X)^. 


(2.5) 


Let  r  =  rank(X,Z)  -  rank(X)  and  f  =  n-rank(X,Z).   Now  the  matrix 
C„  is  a  positive  semidefinite  matrix  of  rank  r;  hence,  Cu  has  r 
nonzero  eigenvalues  (a,,  Ao,  ...»  A  )  and  ra-r  eigenvalues  equal  to 
zero.   Let  Rj,  and  Uy.   denote  matrices  whose  columns  are  the 
orthonormal  eigenvectors  corresponding  to  the  positive  and  zero 
eigenvalues  of  C„,  respectively.   Let  D^  =  Diag(A^,  A2,  •♦.,  A^J  . 
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From  Harville  and  Fenech  (1985,  p.  140), 


t  =  (t^,  t^,  ...,  t^)  =  D^'/2r^  =  \^'^v^^  (^•^) 


is  an  rxl  vector  of  linearly  independent  estimable  functions  of 
^.   Furthermore,  the  best  linear  unbiased  estimator  (BLUE)  of 
t,  (treating  ^  as  a  vector  of  uaknown  parameters)  is 


with 


(t,,  t^.  ....  \]    =  D-'/2r^^^  (2.7) 


E(t)    =  0 

Var(t)  =  CT2Diag(l  +  t^A^,  ....  1  +  t^A^] 


(2.8) 


Now  consider, 

G(Tg,  ^)  =  (f/r)  I    t2/(l+T^A.)/SSE    (_  i_  <  x^  <  =]  ,    (2.9) 
i=l  A 

where  SSE  =  error  sum  of  squares  =  _^'(l  -  X'(X''X)  x)^  -  ^'5; 

A   =  raax(A,,  A2,  ...,A  J. 

We  have  that  ^^r^^^  ^j  ^  ^^^^^^  ^^^  _^*-l  <  t^  <  -,  ^'^^^^  ^*  is  the 

largest  eigenvalue  of  Z'Z.   Furthermore,  G(Tq,  ^)    is  a  strictly 

decreasing  function  of  To;  hence,  if  t  ■.    and  To  are  defined  as 
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p(g(t^,  j)  >  F^  (r,f))  =  a^ 

and  (2.10) 

p[g(t-,  y)  >  F,    (r,f))  =  l-a„, 


where  F  (r,f)  is  the  upper  a-lOOth  percentile  point  of  the  F 

distribution  with  r  and  f  degrees  of  freedom,  then  t,  <  Xo  <  t-;,  is 

a  100(l-a)%  confidence  interval  for  to  (where  a  =  a,  +  a^). 

To  test  the  hypothesis  H  :  tn  =  x   vs  K  :   to  >  x   at  the  a  - 
■'  ^  oBo     aSo 

level,  where  -l/y   <  x   <  ",  we  find  the  value  of  a  for  which 

G(x  ,  ^)  =  F  ,  i.e.,  the  p-value  of  the  test.   We  reject  Ho  when  a 

<  a  . 

The  intellection  of  deriving  a  quadratic  form  which  is  a 
monotonic  function  of  the  parameter  being  tested  is  not  a  new 
concept  in  variance  component  inference  techniques.   For  example, 
Wald's  (1940),  was  the  first  paper  to  contemplate  the  testing  of 
variance  components  when  the  data  are  unbalanced.   In  this  paper, 
Wald  studied  a  simple  one-way  classification  model: 


y.  .  =  n.  +  e  .  . ; 


i=l,2,...a;  j=l,2,...m.,  (2.11) 


where  n .  ~  Nfu.a^];  e  .  .  -  NfO,  a^)  :    r\ .    and  e..  are  independently 
distributed  V...   With  the  model  in  (2.11),  the  objective  is  to 
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derive  a  test  for  the  intraclass  correlation  parameter  given  by 


ct2 

"^  1  1 

P=  = =  —^ ,         (2.12) 

a^    +  a^  1  +  (a^/a^)         1  +  t 

n  n         n 


where  t   =  a^/a^.      Since  p  is  a  monotonically  decreasing  function 
n    n  J  b 

for  increasing  values  of  t   and  the  consequent  test  derived  is  a 
raonotonic  function  of  x  ,  Wald  derived  a  test  based  on  x   rather 


than  p , 


Consider  the  mean  of  the  i*"   group,  y-  .   Then, 


E(y.  )  =  u  and  Var(y.  )  =  (  J-  +  x  )a2         (2.13) 
1 .  1 .      m .     n^ 


Let 


,   a  Zw  .  y . 

Qtta  =  4  I  h-{y- r-^  V]  (2.14) 

1=1  1 


where  w.  =  m./(H-m.x„).   As  shown  in  Wald  (1940),  0,,.  -  y^  ,  and 
1     1     1  n  WA    a-1 

is  independently  distributed  from 


E.Z.[y..  -  y.  J2 
1  VII    -^1.  ^ 

0    =  - - y2      .  (2.15) 

we  9  n   -a 
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Hence, 


Q„^/(a-l) 
^^^o)  =r7U-:^-F(a-l.  n.-a).         (2.16) 

Wc     •  • 


Wald  showed  that  Q^^  is  a  mono  ton ically  decreasing  function  of 

T  .   Consequently,  we  can  test  the  hypothesis  Ho :  t   =  t   vs 

M       1     ^ »  J  V  no 

H^:  T^  >  Tq.   We  reject  Ho  when  F(Tq)  is  "large,"  i.e.,  when  F(t  ) 
exceeds  the  upper  a-percentile  point  of  the  F  distribution  with 
a-1  and  n^ ^ -a  degrees  of  freedom  in  the  numerator  and 
denominator   respectively. 

In  his  1941  paper,  Wald  extends  his  previous  derivations  in 
the  one-way  model  to  a  random-effects  model  having  more  than  one 
classification.   Finally,  in  Wald  (1947),  the  first  paper  dealing 
with  the  mixed  model  appeared  and  like  his  previous  two  papers, 
Wald  derives  a  quadratic  form  that  is  a  monotonic  function  of  the 
parameter  of  interest.   He  approaches  the  problem  in  the  framework 
of  a  regression  analysis  situation. 

Spj4)tvoll  (1968)  showed  that  Wald's  (1947)  method  cannot  be 
applied  in  general  to  any  multiple  classification  model. 
Spj<t)tvoll  considered  a  modification  to  Wald's  method  which  he 
illustrated  on  the  two-way  classification  model.   He  derived  exact 
tests  for  the  variance  components  associated  with  the  interaction 
and  main  effects.   However,  his  tests  for  the  main  effects  depend 
on  the  assumption  that  the  variance  component  of  the  interaction 
term  is  zero. 
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Seely  and  El-Bassiouni  (1983)  presented  conditions  under 
which  Wald's  (1947)  method  could  be  applied  to  mixed  linear 
models.   Developing  Wald's  method  using  reduction  sum  of  squares 
principles,  Seely  and  El-Bassiouni  argue  that  Wald's  method  is 
applicable  whenever  r  (=  rank[X:Z]  -  rank(X))  and  f  (=  n,.  - 
rank[X:Z])  are  positive.   The  derivations  in  Harville  and  Fenech 
(1985)  are  based  on  these  conditions. 

Another  significant  technique  for  deriving  an  exact  test  was 
introduced  by  Thomsen  (1975).   Here  the  idea  is  to  transfer  the 
model  to  a  "semi-canonical"  form  by  using  orthogonal 
transformations  as  we  shall  now  show. 

Consider  the  random  two-way  cross  classification  model: 


y..,  =U+a.+6.+ciB..+e..,; 
ijk        1    J      ij     ijk' 


i=l,2,...,r;  j=l,2,...,s;  k=l , 2 , . . . ,n . ^ , 


(2.25) 


where  u  is  an  unknown  constant  parameter;  a.,  g.,  a3 • ■ ,  and  e..i 
are  independently  distributed  as  N(0,a2),  N(0, ai),  NCO.a^g),  and 
N(0,  ot,) ,    respectively.   Let 


y.  .   =  u  +  a.  +  6.  +  aS..  +  e..  ,  (2.26) 


where  e.  .   =  { 1  J  e.  .,  .   In  matrix  notation  (2.26)  becomes 

ij   k   -^ 


y  =  yl    +  B,ct  +  B^e  +  laS  +  e,  (2.27) 

^     rs     1~    2~         ^ 
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where  B,  =  I  x  1   and  B„  =  1   x  I   (AxB  signifies  the  direct 
1    r   ~s      2   -r    s 

product  of  the  matrices  A  and  B) ,  and 


Var(y)  =  A,ct2  +  A„cr2  +  la^      +   Ka2  ,  (2.28) 

-^     la    2  S     a6     e 

where  A,  =  ^i^i  ^^'^   ^2   ^    ^282;  K  =  Diag(n   ,  n  „,  ...,  n  ). 
Since  A.  and  A.,  commute,  there  exists  an  orthogonal  matrix  P  sucli 
that  PA^P'  =  D^  and  PA^P'  =  D2,  where  D,  and  D2  are  diagonal 
matrices  whose  diagonal  elements  are  the  eigenvalues  of  A,  and  A„ , 
respectively. 

Thomsen  considers  the  orthogonal  transformation 

z  =  P^  (2.29) 

iNote  that  Var(z)  =  PA,  P'a^  .  ...^.  -„  ■  -  -  . 

^  ^  1   a     2   6    rs  a&        c 

vector  z  is  partitioned  into  z, ,  z„ ,  Zo ,  and  z„o ,  where 


;,  =  (rs)  ^^2r   y, 
1  ~rs  -^ 


-a    r-r~     oc     a6    1  e^  ' 


z^  ~  N   (0,    rial  +    Ia2   +  K.a2) ,  (2.30) 

~6    s-l^~     3     ci3    2  e^ 


-aB     (r-l)(s-l)^~    a6     3  e-' 
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where  K, ,  Kj,  and  K^  are  the  corresponding  submaCrices  of  PKP' . 

From  these  random  vectors  Thomsen  derives  quadratic  forms  that  one 

can  use  to  test  the  variance  components  of  the  two-way  cross 

classification  model.   However,  as  in  Spjijitvoll  (1968)  the  testing 

of  the  hypotheses  H   :  o'^  l<j'^    and  H   :  o'i/o'^,    requires  the 
o.ae      o3e^ 

assumption  that  a'^^/o'^-    =   0. 
a6   e 

Khuri  (1986b)  approaches  the  problem  in  m.uch  the  same  way  as 
Thomsen  did  but  applies  an  additional  step.   The  error  sum  of 
squares  of  the  model  can  be  written  as 


'Ke 


(2.31) 


where  ^  is  the  vector  of  observations  and 


R  =  I    -  §  fj    /n. .1  (2.32) 

n      .  .   n.    11^ 
1,1    ij 


is  an  iderapotent  matrix  of  rank  =  n   -rs  (§  is  the  direct  sum 
operator).   Under  the  assumption  that  n   >  2rs  -  1,  it  can  be 
shown  that  Q^^^  can  be  partitioned  as 


\,  =  x^\^ii-  r^'2^2x 


=   Q^^  +  Q^^  .  (2.33) 
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where  Q  h'^    =  fC^C. y/a^    and  Q.  /a^    =    y'C'C^y/a2  are 
le   e   -^      \    !'<■      e  2e  e        ■^      2    V-      e 

independently  distributed  chi-squares  having  degrees  of  freedor 

rs-1  and  n.,-2rs  +  1,  respectively;  C,  is  a  matrix  of  order 

n..^(n..-2rs+l)  such  that  c;c^  =1     ^    ,  and  C'C,  =  0. 

2  2    n..-2rs+l      12   ~ 

Using  the  random  vector  w  defined  as 


w  =  u  +  (a  I    -  1,1  ''2c'y,  (2.34) 

~   ~    ^  m  rs-1    ''     H' 


where  u  =  f  z' ,  z'   z' J'  and  L  is  a  submatrix  of  PKP'  which 
corresponds  to  jj  [recall  from  above  that  P  is  the  matrix  that 
simultaneously  diagonologizes  both  A,  and  A2  and 
K  =  diag(n   ,  n   ,  ...,  n   )) ,  A   is  the  largest  eigenvalue  of 
L.   Khuri  derived  four  sums  of  squares  which  are  distributed 
independently  as  scalar  multiples  of  chi-squared  random 
variables.   These  sums  of  squares  were  utilized  to  derive  exact 
tests  concerning  the  variance  components  a^ ,  a^  ,  and  a^^ . 
In  spite  of  the  arguments  made  by  Thomsen  (1975)  and 
Spjifitvoll  (1968)  that  the  interaction  variance  component  a^^  must 
be  zero,  the  variance  components  of  the  main  effects  can  be  tested 
without  the  assumption  that  o^  /a^  =  0.   However,  the  exact  test 


developed  for  testing  the  hypothesis  H  :  o^ „ / a^    =   0  has  fewer 


a6   e 
denominator  degrees  of  freedom  than  the  corresponding  test  derived 


by  Thomsen  (1975);  hence,  Thomsen's  test  is  recommended  when 
considering  this  hypothesis. 
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In  Khuri  (1986a),  an  exact  test  is  derived  for  testing  the 
variance  component  associated  with  the  nesting  factor  in  an 
unbalanced  2-fold  nested  model  using  a  similar  approach. 

The  derivations  in  Thomsen  (1975),  Khuri  (1986a),  and  Khuri 
and  Littell  (1986b)  are  employed  in  the  next  chapter  to  derive 
exact  tests  for  the  random  and  fixed  effects  in  mixed  models. 


CHAPTER  THREE 
DERIVATIONS  OF  EXACT  TESTS 


3.1  The  Unbalanced  2-Fold  Nested  Random  Effects  Model 


3.1.1     Introduction 


Consider  the  following  model; 


y..,  =y+ci.  +  b+e..,; 

1  =  1, 2,. ..,a;  j  =  l,2,...,m.;  k=l , 2, . . . .n^ ^ . ^ ,    (3.1) 

where  \i    is  an  unknown  constant  parameter;  a.,  b./.\,  and  e...  are 

independently  norraally  distributed  random  variables  with  zero 

means  and  variances 

a^ ,    a,,  and  a^ ,    respectively.   Define 
a    be 


('  ) 


for  i=l,2,...,a;  j=l , 2 , . . . ,m. .   From  (3.1)  we  have 
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whe 


V.  .   =  u  +  a.  +  b. , .,  +  e.  .  ,  (3.2) 

ij         1    j(i)     ij 

re  e..   =  fl/n.,.,!   T   e.  ,.    Alternatively,  (3.2)  can  be 
written  in  matrix  form  as 


y  =  Ul    +  B.a  +  B„6  +  e,  (3.3) 


where  m  =   ;  m. :  1    is  an  m  x  1  column  vector  o£  ones; 

L=l 


B,  =  1   *  1   §...§1    =   (^1     (A  e  B  signifies  the  direct  sum 

12        a   1=1   1 
of 


the  matrices  A  and  B) ;  B„  =   ^  I   =1   ;  a  and  6  are  column 

2    .  ,  m.     m   "-     -^ 
1=1   1 

vectors,  whose  elements  are  a.  for  i=l,2,...,a,  and  b./.s  for 
j=l ,2 , . . . ,m. ,  respectively. 

Consider  the  variance-covariance  matrix  of  y: 

Var(y)  =   B,  B'    a^    +    1  al   +   K  a^  (3.4) 

■^     11a      b      e 

=  A,  a2  +  la?  +  Ka2  , 
la     b     e 

m. 
a    1   _1 
where  A,  =  B,  B"[  and  K  =   ®   §  n.,.s.   Now,  since  A,  is  a 

^     ^  ^         i=l  j=l   J^^^  ^ 

symmetric  matrix,  there  exists  an  orthogonal  matrix  that 

diagonolizes  A,  (see  Graybill  1983,  p.  48).   Let  P  be  the 

orthogonal  matrix  with  the  property  that  PA,P'  =  D, ,  where  D,  is  a 

diagonal  matrix  whose  diagonal  elements  are  the  eigenvalues  of  A,. 
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Lemma  3.1:   The  rank  of  D,  is  a. 

Proof:   rank(D^)  =  rank(PAjP') 

=    rank(Ap    (see    Searle    1982,    p. 197) 

a 

=    rank(B, )    =   rankf    §      1      1 
i  .    ,    ~in.  ^ 

a  1  =  1         X 

=      I    rankd      )    =   a.  □ 

1=1  1 

The  last  step  follows  from  Graybill  (1983  p. 229). 

Now,  since  Dj^  is  an  m,  x  m.  diagonal  matrix,  it  follows  that  D, 
has  "a"  nonzero  diagonal  elements  and  m^  -  a  zero  diagonal 
elements.   The  matrix  A,  is  nonnegative  definite,  hence,  the 
nonzero  diagonal  elements  of  D,  are  positive. 
Let  z  =  P^.   From  (3.4)  we  have 


Var(z)    =    p{Var(_^)}p'  (3.5) 

=    PA,  P'a2    +    I     (jI    +   PKP'a2 
lamb  e 

=   D,a2   +   I     ai  +   PKP'a2 . 
lamb  e 


We  know  that  m^,  ni2,...,ra  are  the  "a"  positive  eigenvalues  of  the 
matrix  A,  (See  Appendix  A  for  proof.).   Hence,  from  (3.5),  we  can 
express  the  variance-covariance  matrix  for  z  as 

Var(z)  =  Diag(mi,  ra„ ,  •  • • ,  m, ,  0,  0,  • • • ,  0)  j2  +  x  a?  +  PKP'a^ . 
'-        ^  a  a    m^  b        e 

(3.6) 
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In  addition  to  determining  the  variance-covariance  structure  of  z. 
we  need  to  obtain  E(z),  where  E(^)  denotes  the  expected  value  of 
the  vector  ^. 

Since  the  positive  eigenvalues  of  A,  are  m, ,  m« ,  ...,  ra  and 

^  _  1/   C  ■  ■) 

A,  =   *  J   ,  it  follows  that  m .  'Zi*^^^  for  i  =  l,2,...,a,  are  the 
l.,m.  i~ 

1=1   1 

eigenvectors  of  associated  with  the  positive  eigenvalues 


I  ^ ,    [ii2  ,    . . . 


,    m      (See   Appendix   B    for    proof.),    where 


~  '■~m  ~lx(ni   -n    )- 


C  ?  V 

p^      =    [o'       :     1'       :    0^ 

~  '-~ni  ~ra^        ~lx(m^-(m    +m    ))- 


~  '-~lx(m    -in    )        ~r 


The  matrix  A,  also  has  a  zero  eigenvalue  with  multiplicity  m, -a, 

Let  e   ,,  e   ^,  ....  e    be  the  orthonormal  eigenvectors 
--a+l   ~a+2       ~m 

associated  with  this  eigenvalue.  We  thus  have 
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el  =0 

~a+l~ 


(3.7) 


~a+2  ~ 


e'    1^^)        =   0, 


for    i=l,2,...,a.      Note    that    from    (3.7), 


e'      1        =    0, 
~a+J6'^^ 


(3.8) 


for  £=1 ,2, . . . , (m, -a) .   The  matrix  P  that  dlagonolizes  A^  can  then 
be  expressed  as 


-  V2,(l)- 


2   ~ 


-  V2,(a)- 
a   ^1 


-a+l 


(3.9) 
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Frora  (3.8)  and  (3.9)  it  follows  that 

E(z)   =  E(P^) 
=  PE(^) 


where  y,  =  y(ra,  2  m„  '^  ,. . .  ,m     ^  )'    of  order  ax  1 ,  and  0  Is  an 
~i      1      z        a  ~ 

(m,  -  a)xl  vector  of  zeroes.   Hence,  we  can  partition  the  column 

vector  ^  into  ^   and  ^,  ,  where 

.(1), 


z  ~  N  {iJ,,[  §  m.a2  +  I  o\   +   v}    ' a"^]] 
~a    a'~l  '•  .  ,  1  a    a  b        e-'  ^ 
1  =  1 


i  {0,,I    a2+K^2^a2]}. 

m  -a  ^~1   in  -a  b        e-'  ^ 


(3.11) 


The  matrices  K^  ^    and  K^  ^    are  the  corresponding  submatrices  of 
PKP'. 


3.1.2    Derivation  of  an  Exact  Confidence  Interval 


=  rr2/rr2 


Concerning  A   =  a^ I a^ 
a    a   e 


In  this  section  we  attempt  to  derive  an  exact  confidence 
iterval  for  A   by  further  analyzing  the  random  vector  t.    .      Recall 
from  (3.11)  that 
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N  {u,  J  »  m.a2  +  I  al   +   ¥.^^^0^' 
a'~l  '-  .  ,  1  a    a  b        e- 
1  =  1 


where  ]j,  =  p(m  2  ^^     '^  ,...,Ta     2  )'.   xhe  first  objective  will  be  to 
obtain  a  transformation  on  ^   so  that  the  resulting  vector  has 
zero  expectation. 

Consider  the  orthogonal  matrix,  T  =  (h,  :  T, )' ,  where 
Jqi  =  m^  -  (m     -^  ,    -m^  ■^  , . , ,  ,m     ^  :    0)'  and  1^  is  an  m,  -  a  column 
vector  of  zeroes.   The  matrix  T,  is  a  matrix  of  order  m,x(m. -1)  of 
rank  m,-l,  whose  columns  are  obtained  by  applying  the  Gram-Schmidt 
orthonormalization  (Golub  (1969))  on  the  columns  of  the  matrix 


W,  =  I   -  h  h'.  (3.12) 

1     ra    ~1~1 


The  Gram-Schmidt  orthonormal  factorization  of  the  matrix  W,  is 

expressed  as  a  product  of  two  matrices,  say  U  and  V,  where  U  is  a 

column-orthonormal  matrix  of  order  m,  x  m,  and  V  is  an  upper 

triangular  matrix  of  order  m,  x  m^ ,  such  that  W,  =  UV.   Since,  W, 

is  an  m,  x  m^  matrix  of  rank  equal  to  m^-1,  one  column  of  U  is  the 

zero  vector  and  the  corresponding  row  of  V  is  also  the  zero 

vector.   The  matrix  T,  will  consist  of  the  matrix  formed  from  the 

nonzero  columns  of  U.   These  nonzero  columns  are  orthonormal, 

hence,  TTr,  =  I^  _, .   Furthermore,  T'h,  =0,    ,x  ,,  since 
1  i    ill.  "^  1~1   "'(.m  -i;xi' 

W,]],  =  0  and  the  column  space  of  T,  is  the  same  as  the  column 
space  of  W,  (this  follows  from  the  Gram-Schmidt  orthonormalization 
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process).   Obviously,  h"!  h   =  1  and  as  mentioned  above,  the  columns 
of  T,  are  orthonorinal,  hence, 


TT'  =  I 


(3.13) 


where,  T  =  (h,  :  T,)'.   From  Khuri  (1985),  the  first  row  of  the 

product  TP  is  m~  '^  V    .      In  addition,  TP(TP)'  =  I   ,  hence,  with 

the  exception  of  the  first  row,  each  row  of  TP  gives  the 

coefficients  for  a  contrast  since  they  sura  to  zero. 

Consider  u  =  T'Py.   From  the  above  results,  we  have 
~     1  -^ 


E(u)  =  T':PE(y)  =  uT'Pl    =  0 
~      1    '^       1  "'m    ~ 


(3.14) 


and  the  variance-covariance  matrix  of  y  is 


Var(u)    =    T';PA,P'T,a2    +   T'T^a^    +   T'PKP'T,a2 
~  Ilia  lib  1  le 

=    T':D,T,a2    +    I         ,a2    +   T'K  T,a2, 
Ilia  ra  -1    b  1         1    e 


(3.15) 


where  K  =  PKP' .   The  matrix  T'jD.T,  is  symmetric,  and  therefore, 
there  exists  an  orthogonal  matrix  L  of  order  (m^ -1 )x (m, -1)  such 
that  LTjD.TjL'  =  A,  is  a  diagonal  matrix.   Consider  ^  =  Lj;.   It 
follows  from  (3.14)  and  (3.15)  that 
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E(£)    =  0 

Var(£)  =  A,a2  +1    ,al  +   LT'K  T,L'a2  . 
~     la    m-lb     lie 


(3.16) 


The  diagonal  elements  of  A,  are  the  nonnegative  eigenvalues  of 

TTD,T,.   The  number  of  positive  diagonal  elements  is  equal  to  the 

rank  of  Tp^T^,  which  is  equal  to  a-1  (see  Khuri  (1985)). 

Now  consider  the  vector  i      obtained  from  the  elements  of  I 
~a  ~ 

which  correspond  to  the  positive  eigenvalues  of  TlD.T,.   The 

vector  I      has  dimension  a-1  with 
~a 

E(2.  )   =0 

*  **  (3.17) 

Var(JZ,  )  =  A  a2  +  I   ,  a?  +  K  a^  , 
~a       a    a-1  b       e 

where  A   is  a  diagonal  matrix  whose  diagonal  elements  are  the 
positive  eigenvalues  of  TlDjT,  and  K   is  the  corresponding 
submatrix  of  LT^K  T^L'.   Now  let 


Q.   =  ii'(A  A*  +  A,  I   ,  +  K**)  h    /a2,         (3.18) 
£    ~a   a      b  a-1         ~a   e 


where  A   =  a^/a^.   A,  =  a}la^. 
a    a   e    b    be 
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Theorem  3.1 

The  quadratic  form  in  (3.18)  is  distributed  as 


^i  ^a-1 

a 

—  1/       *  ^"k     —1 

Proof:  a       2  [^  A   +  A,  I   ,  +  K  )      (Var(!i    )]  =  I   ,,  which  is 
e    ^  a      b  a-1      ^   ^    ~a^     a-1 

idempotent  of  rank  a-1.   Hence,  from  Searle  (1971,  p. 58  Corollary 
2.2),  Q   ~  x^(0)  with  a-1  degrees  of  freedom.   Q 


Let  Q   =      I    (y^-j^  -  y^^.)^*   It  is  known  that  Q/a|  has  a  central 

ijk   -^      ^ 
chi-square  distribution  with  f  =  n,,-m,  degrees  of  freedom. 

Furthermore,  since  Q   depends  on  the  normally  distributed 

~a 
observations  through  a  subset  of  the  elements  of  the  column  vector 

of  means,  ^,   it  follows  from  Lindgren  (1976,  p. 333,  Theorem  3) 

that  Q    and  Q/a^   are  independently  distributed.   Therefore, 


[JI'(A  A   +  A,  I   ,  +  K**l  ^l    ]/(a-l) 
F(A^,A^)  =  '-^^^-^ ^-^ '—^ (3.19) 

.^,^^iJk-"^iJ.)^/("..-.) 


has  a  central  F  with  numerator  and  denominator  degrees  of  freedoc 
equal  to  a-1  and  n^^-m, ,  respectively. 

We  can  now  define  a  100(l-a)%  confidence  region  for  (A  ,A,  ) 
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s(y,A  ,A,)  =  {f(A  ,A,)  <  F     ,       },       (3.20) 


where  F^  ^_^  ^   _^   is  the  upper  a-percentile  point  of  the 

corresponding  F  distribution.   In  order  to  obtain  a  confidence 

interval  for  A^  we  can  consider  the  proiection  of  s(v,A  ,A,  )  onto 
a  f   J  ^-^ '  a '  b 

the  A  -axis.   This  will  lead  to  a  confidence  interval  for  A   with 
a  a 

a  confidence  coefficient  greater  than  or  equal  to  1-a . 

We  have  obtained  an  exact  but  conservative  confidence 

interval  for  A  .   This  confidence  interval  can  be  used  to  test  the 

hypothesis  H^:  A^  =  0.   However,  Khuri  (1986a)  has  derived  an 

exact  test  for  A   which  is  not  conservative.   It  is  recommended 

that  his  procedure  be  applied  instead.   One  advantage  of  the  exact 

confidence  region  for  A   and  A,  derived  is  that  it  can  be  used  to 
°         a      b 

obtain  simultaneous  exact  confidence  intervals  for  all  continuous 
functions  of  these  parameters,  similar  to  those  obtained  in  Khuri 
(1981),  for  balanced  random  models. 


-33- 


3.2  The  Unbalanced  2-Fold  Nested  Mixed  Model 


3.2.1     Introduction 


Consider  the  following  model: 


ijk        1    j(i)     ijk 


1=1,2,... ,a;  j  =  l,2,...,m.;  k=l , 2 , . . . ,n. ^ . ^ ,   (3.21) 

where  y  is  an  unknown  constant  parameter;  a.  are  the  unknown  fixed 

parameters;  b./.s  and  e..,  are  independent  normally  distributed 

random  variables  with  zero  means  and  variances  a?  and  a^  , 

b      e ' 

respectively.   As  witli  model 

n.  .  .  . 
j(i) 
(3.1),  define  y .  . .  =  (l/n.^.^)   I   y..j^,  for  i=l,2,...,a; 

j=l ,2, . . . ,m. .   It  follows  from  (3.21)  that 


y.  .   =  u  +  ct.  +  b.  ,  .  ,  +  e.  .  ,  (3.22) 


where  e • .   =  fl/n.,..!    T   e..,.   In  matrix  notation  we  have 
ij.    ^    j(i)^  ^^^        ijk 


y  =  ul    +  B.a  +  B„B  +  e, 


(3.23) 


-34- 


where  a,   ^,    Bp  and  B2  are  defined  as  in  (3.3)  (Recall  from  the 

a  a 

last  section  that  B,  =  f   1    and  Bo  =  I   ;  m  =  T  a   .  ). 

1-    .,--111.  2.  m.  '   •     ^   i 

1=1    1  i=l 


3.2.2    Derivation  of  an  Exact  Test  Concerning  A,  =  ai/a^ 

°   b    be 


Since,  a.  for  i=l,2,...,a  are  unknown  fixed  parameters,  we 
have  that  the  expected  value  of  the  vector  ^   in  (3.28)  is 


E(y)  =  yl    +  B.a 


(3.24) 


Note  that  B.a  =  [a,!   ,  a„l   ,...,a  1   1  .    The  first  step  to 
1~      l~Tn,    2~in„       a~m  ^ 
1      2         a 

obtain  an  exact  test  for  A,  ,  involves  transforming  the 


/ector  ^  into  a  vector  whose  expected  value  is  the  zero  vector. 
Consider  the  following  tranf ormation : 


:m  =  c^' 


(3.25) 


where 


T..  = 


C  =  »  T.  and 
i=l  ^ 

1//2     -1//2     0 

1//6      1//6     -2//6 


/m. (m. -1 ) 

1    L 


/m.  (m.  -1  ) 
1   1 


■(m.-l) 


/ra.  (m.-l) 
1   1 


J 


(3.26) 
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The 


matrix  T.  for  i=l,2,...,a  has  m.-l  rows  and  ra.  columns  and  is 


of  rank  m.-l.   Hence,  the  matrix  C  has  r,  =   )^  (m.-l)  rows  and  m, 

i=l   ^ 
columns.   Each  row  of  C  defines  a  contrast  in  the  elements  of  y 

and  the  rows  are  orthogonal  to  each  other  (that  is, 

rank(C)  =  r^).   Therefore,  we  have  the  following  results: 

=  uCl    +  CB,a  =  0, 
~m      i~   ~ ' 

where  0  is  a  vector  of  zeroes  of  order  (r,xl).   in  addition, 

Var(z^^)   =  c[Var(i)]c' 

'■  m   b     e-' 

=  CC'a2  +  CKC'a2 
b        e 

=    I      al     +   K  a2,  (3.28) 

r   b      1  e 

m. 
where  K^  =  CKC'  (recall  from  (3.4),  K  =   »   §   n./^));  CC  =  1^. 

follows  from  (3.26).   Now  consider, 


qf,^-^)  =  z;  (I   a2  +  K,a2)-lz„ 
b     ~M  ^  r   b     1  e-^   ~M 


^M(^r^^^^l)"V^l  •  (3-29) 


From  (3.27)  and  (3.28),  Q^  ^   has  a  central  chi-squared 

distribution.   In  addition,  Q  =   J  (y.    ,  -  y.,.,!^  is 

ijk   ^^     J(i)^ 
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independently  distributed  of  Q^^  since  0^^^  depends  on  the 
observations  through  the  column  vector  of  means,  Y  ~  {  y.  •  }  arid 
Yij.  is 


independently  distributed  from  1      (y.-i  ~  Y- •  )"   •■  (see 


Lindgren  (1976)  p. 333,  Theorem  3).   Furthermore,  it  is  known  that 
Q/cr2  ^  x^(0)  with  n,  -  m,  degrees  of  freedom.   Hence, 


z'    (l  A,  +  K.)  ^z^/r, 
~M  *"  r   b     1-'      ~M   1 

F  (A,  )  = ,        (3.30) 

I  (y...  -  y..  )2/(n    -  m  ) 

..,ilk    ii«^     ••    • 

is  distributed  as  a  central  F  with  numerator  and  demoninator 

degrees  of  freedom  r,  =  m, -a  and  n.,-m,  ,  respectively. 

M 
We  can  use  F  (A^)  for  testing 


«o=  ^  <  ^o  ^gai'^^t  H^:  Aj^  >  A^  (3.31) 


where  A   is  some  known  quantity.   Note  that  F'  (Au)  is  a  decreasing 
function  of  A,  ,  hence,  we  reject  the  null  hypothesis  for  large 
values  of  F'  (A^) . 
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3.2.3    Derivation  of  an  Exact  Test  for  the  Fixed  Effects 

In  this  section  we  derive  an  exact  test  for  testing  any 

hypothesis  that  can  be  expressed  in  terras  of  estimable  linear 

functions  of  the  fixed  effects.   Recall  from  Searle  (1971,  p.  180) 

that  a  linear  function  of  the  parameters  is  defined  as  estimable 

if  it  is  a  linear  function  of  the  expected  value  of  the  vector  of 

observations  ^. 

Consider    again   0=1      (y..,    -   v..    )^  ,    vv/hich   can    be    expressed 
ijk  -J 

as 

Q  =  ^'W^,  (3.32) 


where  W=|l    -  %     [j  /n.  ,.,")}.   The  matrix  W  is  obviously 

symmetric  and  has  rank  equal  to  n^,-m,  .   Hence,  there  exists  an 
orthogonal  matrix  H  such  that 

H'Vffl  =  A   or  W  =  HA^H',  (3.33) 


where  At  is  a  diagonal  matrix  with  diagonal  elements  equal  to  the 
eigenvalues  of  W.   Since  W  is  idempotent  it  has  eigenvalues  equal 
to  zero  or  unity  (Graybill,  1983  p. 419).   Thus,  A9  is  a  diagonal 
matrix  with  n, ,-m,  diagonal  elements  equal  to  unity  and  the 
remaining  m^  diagonal  elements  equal  to  zero.   Assuming  that 
n^  ^  >  2m,,  we  can  partition  H  and  A-,  as  follows: 


H  -  [H^:  H^:  H^^ 


A   =  Diag   1,1    .   ,  0 
I  m     n   -zm   ~ 


(3.34) 
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where  H^  H2,  and  H^  are  raatrices  of  orders  n,,xm,  ,  n.  .x  (n,. -2n,  ) , 
and  n,  ,XTn,  ,  respectively;  Q   is  an  m,  .xm,  matrix  of  zeroes.   Note 
that 


H'H  .  =  I,      for  i  =  1,2,3 
11 


h:h.  =0,      for  i  5t  i  . 
1  J   -' 


(3.35) 


From  (3.34)  -  (3.35)  we  have 


=  /"iV  ^/"2"2^  ^^'^^^ 


=   Q,   ^Q,, 


where  Q^  =  ^'H^ir^^;  Q2  =  y:^^^/,^. 

Now  consider 

w  =  y  +  (X    I    -  K)  ^2h'v,  (3.37) 

~   -^     max  m  1-^ 

where  A„_^  is  the  largest  eigenvalue  of  K,  that  is,  A.__„  is  the 
inverse  of  the  smallest  n. /•■>.  The  column  vector  y  of  observations 
can  be  expressed  as 


y  =  yl    +  X,ci  +  X^3  +  e,  (3.38) 


where  X,  and  X„  are  matrices  of  zeroes  and  ones  of  orders  n,  ,xa 
and  n..xm. ,  respectively. 
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Lemna  3 . 2 


The  matrix  (^[j^^-'-m  "'^^     ^^    positiv 


)  '2  is  positive  semidef inite. 


Proof:   Recall  that  K  =  Diag(n 

X    =  {rain  n.,.,}   ,  hence, 
max    '■  .  .         1  (i)' 


-1     -1 


-1 


1(1)'  "2(1)""'  m  (a)' 


and 


X     -  n.  ,  . -  >  0 
max    J ( 1 ) 


i.J 


Consequently,  [X    I   -  K) ,  which  is  a  diagonal  matrix,  is 
max  m 

positive  semidef inite.   Hence,  (X     I   -K)  2  is  a  positive 
semidefinite  diagonal  matrix.    D 

It  follows  from  lemma  3.2,  that  the  matrix  (X     I   -K)  '2  ±s 

'  ^   max   m,  '' 

well-defined  matrix. 
Lemma  3.3 

Cov(^,  yy^)    =   0  . 
Proof:   We  have  that  y  =  Gy,  where 


G  =  Diag(n  ,  .K     ,  n  ,  .1'     ,  . . .  ,n   /  n1'  /  n 
l(l)~n^^^^    2(l)^n2(^)       m^(a)~mja) 


Let  E  be  the  variance-covariance  matrix  of  y.   From  Lindgren 
(1976,  p. 333,  Thm  3),  ^  and  the  residual  sum  of  squares,  Q,  are 
statistically  independent,  hence  from  Searle  (1971  p. 59  Thm  3),  we 
have  GIU  =  0  (recall  from  (3.32)  that  Q  =  ^'Wj).   But, 


GZU  =  0  <=>  GZ(H  H'  +  H^H'J 


(see  (3.41)) 


-40- 


=>    GZ^U^U'^   +   H^H^JH^    =    0 

<=>    GEH^   =    0.  (see    (3.40)) 


Then,    Cov(^,y^Hj    =   Cov(g^,^'hJ    =   GZH      =0.        D 


Lemma    3.4 


(i)         HriH,    =  j2l 
11  em 


(ii)      Wl  =0;      IaJX,    =   0    . 

~n  ~  1        ~ 


Proof:      (i)      The   matrix  E,    the    variance-covariance    matrix   of 
^,      can    be   expressed    as 

Z    =   X   x:a2   +1        a2,  (3.39) 

2    2    b  n        e 


where  X_  =  *   1      .   Consider  the  matrix  product  WX^ ; 
2    .  .~n .  ,  . ,  2 


WX„  =  [l   -  »  (n.^.^J     )]   ®  1 

2    '■  n     .  .  ^  j(i)  n.  -  . .  '^-'  .  .~n.  .  .  . 


»  1      -  ®  fn.i.,J     If  »  1     1 
.  .~n.,..    .  . '^  j(i)  n.  ..-'''■.  .~n...--' 


»  1  -  «  [n. J.,J  1  ] 
.  .~n,,.,  .  . '-  j(i)  n.  ,  .  .--n.  ,  .  ,-' 
i,J   j(i)    i,J        j(i)   j(i) 


»  1      -  *  1      =0 
.  .~n  .  ,  .  .    .  .^n  ....    ~n   xm 
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Heiice , 


=>   h;(h^h:|   +  H^H^JX^  =  0 

<=>    H'X      =    0,    since   H'H,    =    0   from    (3.35) 


From    (3.39)    we    have 


H'EH      =   H-;(x„x:a2    +    I     a2)H 
11  1^22b  me^l 


=    H'X   x:H   a2    +    H'H   a2 
1221d  lie 


=   H'H,a2 
lie 


(since    H'X..,  =    0) 
12       ~ 


=  a2i        . 
e   m 


(ii)    The   ma 


d  J. 

trix   X,    =     ®    1  (where    n.      =     T    n..).      We    have 
1         .     ,~n.  !•         .^,    ij 

1=1      1.  j=l      -> 


WX,    =      I        -      ©      (n.J.,J  )    0+    1 

1        "■    n  ..    ^    j(i)    n.  ,..-'■'  .      ~n. 

••      i,J  jd)      1=1      1- 


»    1        -   [    ®   [n.J.,J  )][      »    1        ] 

.     ,~n.         '-  .     .^    j(i)    n.  ,  .  /  J  '■     .      ~n.    ^ 
1=1      1.         i,j      -^  j(i)  1=1      1. 


But,   ®   1     can  be  expressed  as 
.  ,  ~n. 
1  =  1    1. 


a         a     1 

§1    =§r(®i    111; 

1=1   1.    1=1    j=l   j(i)    1 


hence, 


WX,  =   »   1    -   ®  fn.  ,.  -  J      1    ®  (  ®  1      ]  1 
1    .  ,  ~n.    ^.     ."-    j(i)  n. ,./■"-.  /.  ~n.,.,^~m.-' 
1=1    1.    i,j   -J      j(i)    1=1  j  =  l   j(i)    1 
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»    1  -      ®        (    I*  n.^^-J  1  111 


a  a  1 

=      »    1  -      »   [f    ®    1  ll      ] 


®      1  -     ®    1  =0 

i=i ''"i.    i=r"i.    -^".."^ 


Furthermore , 


Wl  =1  -®(n.,.,J  )»1  1 


=in       -»1  ]l       =1         -1         =0         ,n 

i,j      j(i) 


Using    the    results    of    lemmas    3.3   and    3.4,    we    have 


E(W)    =   E(y)    +    (X         I      -K)    ^2     H^ECy)  (3.40) 

~  '^  max   ra  I      -^ 


=  Ml        +   B  a   +    (A        I        -K)    ''2h'(u1        +   x,a) 
~m  1~  max    n  1      ~n  1~ 


=  Ul        +   B,a 
~m  1~ 


Note    that   H^Cuj^^        +   X^a)    =    0    by   lemma    3.4(ii)    and    (3.35),    since 
W   =   HjH^    +   H2H2.      In    addition,    the    variance-covariance   matrix   of   \g 
can    be   expressed    as 

Var(w)    =    Var(y)  +  (A         I      -K)    ^^2  H-;Var(  y)H ,  ( A         I      -K)    ^2 
■<-  max  m^  1         '^'    p    max   m^       ^ 

=    Var(y)    +    (A         I      -K)    ^2h;zh,(A         I      -K)    ^2 
-^  max   m  1       1      max   m 
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Var(y)  +  (A         I      -K)    '^  {\        I      -K)    ^2^2    (gee    lemma    3.4(i)} 
'*'  max   m  max   me  ^ 


I      02    +    Ka2    +    (X        I      -K)cr2 
m      b  e  max   m  e 


I      fa2    +  A        a2}    .  (3.41) 

m    ^    b  max   &■' 


Consequently,    w  can   be   expressed    as 


w  =   Ml        +    3,a  +   B^B   +  e    +    (a        I      -K)      2H'y,  (3.42) 

~  ~m  1^  2~        ~         ^    max    m  H 

but,    H'y  =   H'ful  +   X,ci  +   X„6   +   el;    hence,    from   lemma    3.4, 

l'^  1  ^   ~n  i~  2~        ~-^ 

H'y  =   Hie    and   we    have 
1~  1~ 


Vo 
w  =   ul        +    B,a   +   B,3   +  e   +    (A         I      -K)     -W'e    .  (4.43) 

~  ~m  1~  2~        -^  max    m  1~ 


Let  X,  £  and  jg   be  defined  as 

fi*  =  t^  =  S'J''  (3.44) 

*  -  Vt 

and  e  =  B^B  +  e  +  (A    I   -K)  ^\V,e. 

~      2~    ~     max  m         1~ 


Using  (3.44)  we  have 


■k  "k 

w  =  X£   +  e   .  (3.45) 


Note  that  from  (3.41)  and  model  definitions 
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e  ~  N   jo,  I  (a}    +  \        o^)] ,      Consider  the  normal  equations 
~     m  ^~   m  ^  b    max  e^' 

stemming  from  the  generalized  least  squares  of  (3.45),  that  is, 


X'[Var(w)]  ^X£°  =  X'[Var(w)]  ^ 


<=>   X'X£°  =  X'w    (see  (3.41)  above), 

with  a  solution 

£°  =  (X'X)"x"w  (3.46) 

where(X'X)   represents  a  generalized  inverse  of  the  matrix  X* X. 
We  are  interested  in  testing 

H  :   R'p  =  m,  (3.47) 

o     ~   ~' 

where  R'  has  full  row  rank  (let  rank(R")  =  s)  and  R'  =  F'X  for 
some  matrix  F'    ,  that  is,  R'g  are  estimable  linear  functions  of 
£;  m  is  a  vector,  of  order  sxl  of  specified  constants.   Now 
consider , 


I    ^^^    =    rp°   -   m  .  (3.48) 
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Theorem    3.2. 


"a  ~a  ^        X   ^      ~a 


-1  *2 

x2'[s,    (R'p-iii)'(R'G    R)      (R'p-m)/2a      ], 


G^   =    (X'X) 


*2 

;    a        =  a2    +  X        a^ 
b  nax    e 


Proof:      e(£  )        =    R'E(£°)    -  m  =    R'(X'X)    X'X£- 


=    F'XCX'X)    X'X£    -   a    =    F'X  £-m    =    R'£ 


nd  Var(£    *-^^^)    =    R'Var(£°)R 


=    F'XCX'X)    X'[Var(w)]x(X'X)    X' F 


=   F'X(X'X)    X'X(X'X)    X'F   [al    +  A        a^] 


b  max   e"^ 


R'(X'X)    Rial   +   X        a21 
^    b  max    e^ 


Hence , 


I    '■■'^    ~   N    [r'p    -   m,    R'G^Rfa^    +   A        a2 ' 
~a  gi-      ~        ~  X    ^    b  max    e^ 
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Therefore,  from  Searle  (1971,  p. 57,  Thm  2),  the  proof  is  complete.  [] 
Now  consider 


SSE    =  w  w  -  £   X  w 


(3.49) 


Theorem  3.3 


=  w'w  -  w"X(X'X)  X'w 


w'fl   -  X(X'X)  X']w 


SSE   /a   ~  X 


Proof:   We  know  that  T   -X(X'X)  X'  is  an  iderapotent  matrix  with 


ikfl   -  X(X'X)  X'l  =  trace  fl   -X(X'X)  X'l 


=  rank[l   )  -  rank(X) 


Furthermore,  E(w)  =  Xp ,  hence. 


;e(w)]'[i   -  X(X'X)X'][e(w)] 
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=  p'X'Fl   -X(X'X)'X'lXp 


=  0. 


Hence,  from  Searle  (1971,  p. 57,  Theorem  2), 


/a   ~  x'^^    • 


SSE 


In  addition,  we  have  the  following  theorem, 
Theorem  3.4 


(M)        (M) 
Q    and  SSE    are  independently  distributed. 


Proof; 


a*%f^  =  (R'£°-n})'(rG  R)-^(R'fi°-m) 


=  (r'(X'X)  X-'w-ni)-'(R'G  r)  ^(r'(X'X)  X'w-m) 


We  can  express  jn   as 


m  =  R"R(R'R)   m  =  F'XR(R'R)  ^m  =  F'XG  X'XR(R'R)  ^ 


=  R'G  X'XR(R'R)  ^m  . 
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Hence , 


a*   q^^^^    =    (w-XRCrR)  ^m)'[XG,^R(R'G^R)  ^R'G^Ji' ]  ( w-XR(R' R)  ^m) 


Now, 


(M)         r 

SSE'  '  =  w'[I    -  X(X"X)  X^ 


(w-XR(R'R)  ^nl'fl   -XG,XKw-XR(R'R)  ^ml 
~  ~    m    A    '•■'  '••■■^ 


since  X'fl   -  XG^X'l  =  0  .   We  hav« 
m      X   ^    ~ 


XG^R(r'G^R)  ^R"G^'[Var(w-XR(R'R)  ^m)  1  f  I   -XG^X' 
X      A        X        ~  ~ni     X 


J  1VV.R  G  R)   1\  u  ^  1  i   ^^v-^   JV^i.    '   '^        '-'    ) 
X     X       X   ^  m    X   ^  ^  b    raax  e^ 


XG  R(R'G  R)-  R'G  X-(I   "XG  X' )  ( a2  ^  X  ^a^. 


=   0  . 
It  follows  from  Searle  (1971,  p.  59,  Theorem  4)  that  Q*^^')  and 
SSE^'  '    are  independently  distributed.     D 

Consequently,  it  follows  from  theorems  3.2,  3.3,  and  3.4  that 


I    ''''    (R'G  R)-^£  ^"Vs 

F(H)  =  ^ -f ^ .  (3.50) 

SSE^  V(m  -a) 


F'[s,  (m^-a),  (R'£-m)'(R'G  r)  ^(R'£-m)/2a   ] 
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Under  the  null  hypothesis,  H  :  R'£  =  m,   the  noncentrality 

parameter  is  zero  and  F(H)  -^  F   /  -a.)'    ^^^^    ^^j  F(H)  has  a 

central  F  distribution.   Hence,  F(H)  provides  an  exact  test  of  the 

hypothesis:   R'p  =  m.   In  particular,  we  can  test  the  hypothesis 

H:a,  =ct«  =  «««=a. 
o    1     2  a 

Consider  the  following  example  where  a  manufacturer  is 
interested  in  studying  the  burning  rate  of  powder  from  three 
production  processes  (the  fixed  effects).   Three  batches  (the 
random  effects)  of  powder  are  randomly  selected  from  each  process 
and  three  determinations  of  burning  rate  (in  minutes)  are  made  on 
each  batch.   The  results  are  shovm  below,  in  Table  3.1,  where  some 
of  the  data  have  been  deleted  to  illustrate  the  analysis  of  an 
unbalanced  design. 
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Table  3.1     Example  of  an  Unbalanced  2-Fold  Nested  Mixed  Modal 
(Source:   Montgomery  (1976  problem  11-2,  p.  281)) 


Process 


Batch 


Burning  Rate 


25,  30 

19 

15,  17,  14 

19,  17,  14 

23,  24,  21 

35,  27,  25 

20 

25,  33 


Using  the  program  in  Appendix  E,  we  test  the  significance  of 

the  fixed  nesting  effect  and  the  variance  component  associated 

with  the  random  nested  effect. 

Results : 

For  testing  H  :  A,  =  0  vs  H  :  A,  *  0, 
°   o   b         a    D     ' 

where  A,  =  a^ /a^  . 
D    be 

test  statistic  =  7.53  with  numerator    df  =  5 

denominator  df  =  10 

p-value  =  .004 

For  testing  the  H  =  a,  =  cco  =  a^  (i.e.,  the  fixed  effects) 
"        o      i      Z      J 

test  statistic  =  .288  with  numerator   df  =  2 

denominator  df  =  5 
p-value  =  .762 
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3.3  Reduction  of  the  Exact  Tests  when  the  Design  is  Balanced. 

In  this  section  we  investigate  what  happens  to  the  exact 
tests  derived  in  the  last  section  when  the  design  considered  is  a 
balanced  design.   The  conventional  tests  applied  when  the  design 
is  balanced  have  been  shown  to  have  optimal  properties;  hence,  a 
desirable  property  for  the  derived  exact  tests,  is  that  they 
reduce  to  these  conventional  tests  when  the  design  is  balanced. 
If  the  exact  tests  reduce  to  optimal  tests  under  a  balanced  design 
future  research  on  optimal  tests  for  unbalanced  designs  may 
commence  with  these  newly  derived  exact  tests. 

Consider  the  2-fold  nested  mixed  model  in  (3.21),  but  with 
i=l,2,...,a;  j=l,2,...,m;  k=l,2,...,n,  that  is,  the  design  is  now 
balanced. 

3.3.1     Reauction  of  the  Exact  Test  for  the  Fixed  Effects. 
Recall  ji  in  (3.37) 


l/„ 
w  =  y  +  (X    I    -  K)  '-^H'y 
~   '^     max  m  1''' 


Under  the  balanced  situation  we  have  n./.-j  =  n   ..,  hence,  the 
matrix  K  reduces  to 


K  =   »   n.J.,  =   »   n  ^  =  n  4   ,  (3.51) 

.  .   J ( 1 )    .  .  am 
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where  am  =   )  m.   Therefore,  A    ,  the  largest  eigenvalue  of  K, 
L  >   max'        '^      ^  ' 

1=1 

becomes  I/n.   Consequently,  under  a  balanced  design, 


y  =  u 1   +  B,a  +1  S  +  e, 
'^    ~ara     I~    ara~   ~ 


(3.52) 


where  B,=   ^   1   =1  xl.   Proceeding  as  m  (3.44)  v/e  now  have 
1    .  ,  ~m    a   ~m 
1=1 


X  =   I    :  B,  , 


P   =  y  :  a'. 


(3.53) 


and 


e   =1   S  +  e  . 
~     am~   --^ 


Hence,  alternatively,  (3.52)  can  be  written  as 


w  =  Xg^  +  e 


(3.54) 


A  solution  to  the  normal  equations  stemming  from  model  (3.54)  is 


£°  =  (X'X)  X'^ 


(3.55) 


Lemma  3.5 


mn   1 ^  am 


~n^'^ 
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that    is,    u°   =   0   and   a°   =  —  Bt f I        x    I'lv   is    a    solution    to    the 

mn   1  ^  am   ~n^'^ 

normal  equations  of  model  (3.54). 

Proof:   The  matrix  X'X  can  be  expressed  as 


X'X  = 


r      1    :  B, 
~am   '-~am     1- 


L»-iJ 


ml 
L  ~a 


ml 


ml 


Now,  rank(X'X)  =  rank.(X)  =  a,  and  applying  the  algorithm  described 
in  Searle  (1982,  p. 218),  a  generalized  inverse  of  X'X  is  given  by 


(X'X) 


ll 
m  a 


(3.56) 


Hence, 


£   =   (X'X)  x^x 


il 

m  a 


r 

~am 


J 
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0' 
~am 

m      1 

'-           J 

-Ir 


ut,  y  =  n    I   X  1'   y;  hence,  we  have 


o    1 


U   =  0   and  a   =  —  Brfl   x  r]y.     □ 
~  ~    mn   1^  am   ^n^-' 


Now,  recall  from  (3.50)  that 


F(H) 


w'fl   -  X(X"X)~X')w/(m  -a) 


is  the  test  statistic  derived  to  test  the  H  :  R'p  =  m,  for  an 
unbalanced  design.   From  lemraa  3.5  we  have  seen  a  solution  to  the 
vector  g,*-*  when  we  have  a  balanced  situation.   What  happens  to  the 
denominator  of  F(H)  when  we  have  a  balanced  design? 
Lemma  3.6 

Under  a  balanced  design  w'fl   -X(X'X)  X'lw  becomes 


-  y^[n~\l        X    J  ^ 
n  -^  '•    ^  am     n' 


-1 


-  (mn)  (l      X  J  ]]y 


a    mn' 


Proof:   From  (3.52),  we  know  that  under  a  balanced  design 
w  =  y  and  m,  =  am  •   Hence, 
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w    (l         -   X(X'X)    X'lw   =  y'tl         -    X(X'X)    X' J 


From    (3.53)    and    (3.56), 


X(X'X)    X'    =        1         :    B  I 
-'am  1 


Ixam 


in      1-1 

-B,  B-:  =  -  (i    X  1  )(i    X  r  ) 

rail        ra    ^    a        ~in^  ^    a  ~m^ 


Consequently, 

w'  (l 


=  -   I   X  J 

m  ^  a    m^ 


-  X(X'X)  X'Jw 


-^   ^  am   I?.   a    n^^-i 


^  y(i     X  1  ][i     -  1  (i    X  J  )](i     X  r)  y 

o'^  '^  ^  am   ~n^  '-am   m  ^  a    m^  ■'  ^  am   ~n^  -^ 


n  -^  '-    ^  am    n-^ 


-1 


-  (ran)   fl   X  J   11  y  .    D 


Hence,  from  lemmas  3.5  and  3.6  and  (3.56),  we  have  with  a  balanced 
design. 


F(H)  = 


[R'p°-m)'(R'G^R)  ^(r^p  -m) /s 

n'^v'I'n'Vl   xj  l-(mn)~^fl  xj   lly/(am-a) 
*  '^    '~  am   n^       ^  a  mn''  ■''^ 


(3.57) 
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Consider  the  conventional  F  used  when  we  have  a  balanced 
2-fold  nested  mixed  model  and  we  are  interested  in  testing 
estimable  linear  functions  of  p,  i.e.,  R'p.   From  Searle  (1971, 
p.  190),  the  conventional  F-test  can  be  expressed  as 


R'p   -ml'fR'G  .r1   (r'p   -ml /s 


F,  = 


1        a    m   _ 

y'[  ©  I  *  n   J J   lly  /(am-a) 

-^  '-  .  ,  ^  .  ,     n    mn   mn'  ■'•^ 
1=1  j=l 


where  G  ^  =  fx  X  1   and  X  =  X  x  1 


£   =  l^ 


IP   =PJ. 

Note  that  we  are  using  the  superscript  '*'  since  we  use  the  Y-^-jj^^'s 
(i.e.  model  (3.38))  rather  than  the  Y^^  's  (i.e.  model  (3.23))  in 


deriving  the  conventional  test. 


Theorem  3.5 


F(H)  =  F^  . 


Proof:   First,  consider  the  denominator  of  Fp   We  have 
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a    m    _ 
y'[  ®   {  ©   (n   J  )  -  —  J   }]y 
1=1   j=l 


=  ^ 


i=l 


I  n"Hl  xj  )  -i-  J   }]v 


a   n^    mn   mn' 


=  vM  n  ^  (l   xj  1 i-  (  I  xj   )]  y. 

-^   '■      ^  am   n-'    nn  ^  a   mn^-'-^ 


Now, 


■k'     -k 

X   X 


I  X  r 


[1 


I   X  1 


aran      mnl' 
mn 1       mn I 


(note  that  n,,  =  amn  when  the  design  is  balanced).   Again, 
applying  the  algorithm  described  in  Searle  (1982,  p. 218) 
concerning  a  generalized  inverse. 


X  X  ) 


0      — I 
~a     mn  a 


=  -  X'X 


(see  (3.56)) 
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Consequently, 


■k-"  ,     -k-     -k.   -        A' 


and  therefore, 


0' 
~a 

i-I 
mn  a 


mn  ^  a  ~mn^ 


I  xr 
a  ~mn 


y  =  £     (see  lemma  3.5), 


n(R'£°-  m}'(R'(X'X)  r)  ^(R'£°  -  m) /s 
^   y'  [n'^fl  xj  ]  -— (l  xj   )]y/(am-a) 


am  n^    mn^  a   nn^ 


=  F(H)  . 


We  have  demonstrated  that  the  exact  test,  derived  in  the  last 
section  for  testing  estimble  linear  functions  of  the  fixed  effects 
when  the  design  is  unbalanced,  reduces  to  the  conventional  F-test 
when  the  design  is  balanced. 
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3.3.2    Reduction  of  the  Exact  Test  Concerning  A,  =  a^ /ct^ 

b    be 


Without  loss  of  generality,  let  A   =  0,  and  recall  from 

(3.30)  that  for  testing  H  :  A,  =  0   vs   H  :  A^  >  0  we  derived  the 

o   b  a  b 

following  test  statistic: 


FA  =0   = 


h,   S^£,i/ri 


I  (Y...-y..  )2/(n   -m  ) 
.^,^  Ilk  -^11.^     ••   • 


where  z   =  C^  ,  K  =  CKC  ,  r  =  \    {m.-\),    and  n.  =  [  m.  (recall, 
"  i=l  i=l 


C  =   §  T.,  where  T.  is  defined  in  (3.26) 
i  =  l  ^         ' 


Consider  the  conventional  F-test  employed  when  the  design  is 
balanced : 


^2  = 


V    [fl     xj   1/n   -    [l   xj      ]/mnl  v}/a(in-l) 
•<>      '-  ^    am     n^ *-    a      mn-^         -'-^^ 

I    (y.  .,    -    y.-    )2/am(n-l) 
ijk        -J 


(3.59) 


see   Khuri    (1982)1 . 
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Theorem  3.6 


F  (0)  =  F(A   =  0)  =  F.  when  we  have  a  balanced  design. 
o         / 


Proof:   When  the  design  is  balanced  we  have 


£m  h^  hx^'i  =  ^n^^^'^^y^  V^i 


But,    using    the   matrix  T   defined    in    (3.26), 


ny'[l   xt;       ,,       ][l    XT,       ,  .       ]y 


=   nril   ^T-T]v 


=   ny'[l   x(i      -  1  J    )]y 


am        mm' 


=   ny'fl        -  -  (  I   xj 


^^ 


am        m    ^    a      ra' 


-1 


ut,    y=n      (I      xl'lv;    hence. 


nz'z^,    =   n     y  l(i     '^Ol  I      ^1' 
'-'M'^l  ^    L^    am  ~n^  ^    am  ~i 
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-   -    f  I        Xl     J[I     XJ     j(l        xrj      y 

m    ^    am  ~n^  ^    a      m^  ^    am  ~n^  -''^ 


am     rr^        m    ^    a      m 


n     y'      I      xj I   xj  xj        y 

■^    '-  ^    am     n-^        m    ^    a      m      n-"  ■'-^ 


^    ^    3''[[l       ^J    )     -  -    (l    xJ       ]]y 
^     •■  ^     am        XT'  m    ^     a        mn^-'^ 


am      n-'         m   ^    a      mn^ 


=  y[-  (I  XJ )  -  —  (I  XJ  )]^ 

-^    "-n    ^    a;n      n-^         nin    ^    a      mn^  ■'-^ 


Furthermore , 


■      =      I      (m   -1)    =    a(m-l); 
i=l 


y      m.    =   am 
i=l      ^ 


Consequently, 


F^fol    = 


{r    [-  (l      XJ    )    -  1      (l      X    J      )]y}/a(m-l) 
'■'^      '•  n   ^    am      n^         mn    ^    a mn^  ■''^' 

I         (y-  •  1    "    y-  ■    )^    /    (n      ~3ni) 
.'i ,       ^    11  k  ij .  •  • 

ijk  -^ 


F,    .  D 
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3.4  An  Unbalanced  Mixed  Two-Way  Crossed  Classification  Model 
with  Interaction 

3.4.1     Introduction 

Consider  the  following  model: 


y..,  =u  +a.  +6.  +  (a8)  .  .  +  e  .  ., 
ijk        1    J       ij     ijk 


i=l,2,...,r;  j  =  l,2,...,s;  k=l , 2 , . . .  ,n . ^  , 


(3.60) 


where  u  is  an  unknown  constant  parameter;  a.  are  the  unknown  fixed 

parameters;  3-,  (oi8)..,  and  e...  are  independently  normally 

distributed  random  variables  with  zero  means  and 

variances  a^   a^„ ,  and  a^ ,     respectively. 
3    0(6       e'       '        ' 

n 

Define  y.  .  =   )   v  ,  /n    •   Then, 
iJ    k=l  ^^^    ^^ 


y..  =iJ  +a.  +e.  +  (aS) .  .  +  e.  . 


(3.61) 


where  e..  =      )      e..,/n...   In  matrix  notation  (3.61)  can  be 
expressed  as 


2   "  l^^ 


+  B  a  +  B  6  +1   (a3)  +  e  , 


(3.62) 


where  B 


I  >:  J.   and  B^  =  ,1   x  I  ;  ci ,  ^ ,  and  a3  are  column 


vectors  whose  elements  are  a.  for  i=l,2,...,r,  3-  for 
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j=l,2,...,s,  and  (aB)--  forV..,  respectively; 

3.4.2    Derivation  of  an  Exact  Test  for  the  Variance  Components 
Associated  with  the  Random  Effects 

The  expectation  of  the  vector  ^  in  (3.62)  is 


Efvl  =  pi    +  B,a,  (3.63) 


with  a  variance-covariance  matrix 


Varfyl  =  A„a2  +  la^ ^    +   Ka^  ,  (3.64) 

^'^■'  2  3     ci6     e 


where  At  =  B^B:;  =   fl   xil'xl=j  xl 
Z    z  Z    ''~r    s^  ^~r    s-^     r    j 


K  =  Diag  fn,,,  n, ^ ,  ....  n   1.   Note  from  (3.63)  that  the 
^11    12        rs^ 

expectation  of  the  vector  y  involves  the  column  vector  a.   As  in 
Section  3.2.2,  we  need  to  obtain  a  transformation  that  removes 
these  nuisance  parameters  in  order  to  obtain  an  exact  test  for  the 
variance  components  associated  with  the  random  effects. 
Consider  the  following  transformation, 


z   =  C  y. 


(3.65) 
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where  the  subscript  t  indicates  that  we  are  considering  a  two-way 
crossed  classification;  C   =  I  x  T,  where  T  is  a  matrix  now 
defined  as 


1//2      -1//2     0 0 

l//"6       l/Z'e     -2//"6     0 0 

-(s-1) 
l//s(s-l)    l//s(s-l)   /s(s-l) 


(3.66) 


The  matrix  T  has  s-1  rows  and  s  columns.   Hence,  the  matrix  C^. 
consists  of  rx(s-l)  rows  and  rs  columns.   Each  row  of  C^.  defines  a 
contrast  on  the  elements  composing  that  row,  and  the  rows  are 
orthogonal  to  each  other.   From  (3.63),  (3.64),  (3.65)  and  (3.66) 
we  have  the  following  results: 


Efz   )    =    0 


(3.67) 


Varfz   )    = 


C  A^C'al   +  C   C'a2^    +   c  KC'a^ 
t2tS  ttaS  tte 


C  AS^ai   +    I 


o-^^   +   C   KC'a^ 


t    2    t   6  rx(s-l)   aS  t"     t    e 


(3.68) 


Note  that  C^C^  =  Ii-x(s-l)'  since  TT'  =  lg_p  and 

C,C^  =  (I^xT)(I^xr)  =  i^xir.   Hence, C^C;  =  I^xl^_^  =  Irx(s-l)- 
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The  matrix,  C  A2C'',  has  eigenvalues  r  and  0  with  multiplicity 
equal  to  s-1  and  (r-l)(s-l),  respectively  (See  Appendix  C  for 
proof.)*   In  addition,  C  A2C^  is  symmetric;  hence,  there  exists, 
an  orthogonal  matrix  P  of  order  (rs-r)x ( rs-r)  such  that  ?C^k2^\^' 
=  D  ,  where  D   is  a  diagonal  matrix  whose  diagonal  elements  are 
the  eigenvalues  of  C  A^C' . 

Consider  the  transformation 


M      =    Pz  (3.68) 

~t  ~t 


From    (3.67) 


E(ti    )    =    0  (3.69) 


and 


Var(M    )    =   PC   A^C'P'a2    +    I  o^      +   PC    KC'P'a2 

~t  t   2    t        6  r(s-l)   a6  t      t        e 


D  a2    +   I   ,      , .a^„   +   L  a2 
t   6  r(s-l)   ag  t    e 


)iag   [(ra2   ^a^^)!^.^,   a^^ I^^_^ ^^^.^^j    ^   L^aJ 


Where    L^   =    PC^KC^P' . 
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Now,  model  (3.60)  can  be  expressed  in  matrix  notation  as 


y  =  yl   +  X-a  +  X„e  +  X„(a6)  +  e, 


(3.70) 


where   X,,    X^,    and    Xo    are   matrices    of    zeroes    and    ones    of    orders 
n^,^r,    n,  ,xs,    and    n,  ,>:rs,    respectively.      We    have 

Z      =   Var(y)    =   X-X;a2    +   X-X;a2      +1        j2  .  (3.71) 

t  ^'^'^  2    2  3  3    3  a6  ".      '^ 

Consider 

Q    =    I    (y..,  -  y--  )^  ^3.72) 

ijk  -^ 

which   can   be    expressed    as 

\  =  r^t^.  (3.73) 


®  fj   /n..l.    The  matrix  W^  is  iderapotent 
.  .    n .  .   IV  ^ 

and  s>Tnmetric  with  rank  equal  to  n^^-rs.   Hence,  there  exists  an 
orthogonal  matrix  H   such  that 


W  =  H  AH',  (3.74) 


where  A-,  is  a  diagonal  matrix  whose  diagonal  elements  are  the 
eigenvalues  of  W  .   Hence,  Ao  has  n^ , -rs  diagonal  elements  equal 
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to  unity  and  rs  diagonal  elements  equal  to  zero.   We  can  partition 
Ao  and  H   in  a  manner  similar  to  Khuri  (1986b)  and  obtain 


._  =  Diag  (l  ,      ..,    I,    0   ^   ^.  O)        (3.75) 
3        ^  r(s-l)    (n   -2rs  +  r)  ~^ 


and 

where    0   is    a   zero    matrix   of    order    rsx  rs    and   H^^  j^ ,    H^2>    ^nd    Hj. -^   are 
matrices    of    orders    n.,xr(s-l),    n, .x (n. . -2rs+r) ,    and    n..xrs, 
respectively.      In    (3.75)    we   roust    necessarily  have 


n        >   2rs-r 


(3.76) 


In  addition,  note  that 


H'  .  H  .  =  I,       for  i=l,2,3 
ti   ti 


H'   H   =0,       for  i  ^  j  . 
ti   ti 


(3.77) 


From  (3.73)  -  (3.77)  we  can  express  Q  as 

Qt  =  -^'"ti^'ti  ^  ^  -x'H,2»;2  ^ 

=  '^tl  ^  '^t2  ' 


(3.78) 


where  0 


^ti  =/»ti»;i^'  \i  =  ^^\2Ki^ ' 
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Consider  the  random  vector  w  expressed  as, 


w   =  u  +   (X^      \    ,      ,  ,  -  L  )  '2h'  V, 
~t   ~t    ^  max  r(s-l)     t'  t  !•* ' 


(3.79) 


where   X  is    the    largest    eigenvalue    of    L.  .      Note    that    the   matrix 

max  o  t.  (- 

[\        I    /       ,x    -   L^l    '2    is    a   positive    semi-definite   matrix;    hence, 
^    max   r(s-l)t''  ^ 

it    is    a  well-defined   matrix. 


Lemma    3.7 


(i)        W    1  =   W  X,    =   W  X^    =   W   X_    =    0 

t~n  t    1  t    2  t    3 


(ii)      Cov(y^,    r^j)    =   0    . 


Proof    (i) 


W    1  =1 

t~n  '■    I 


®      (nT^    J         )][ 

^    11       n.  .     -' '-  .     .~n.  .■'~rs 


1  1 


■  ®  1       -  [  e    1      111 

■  .     .~n.  .         '-  .     .    ~n.  .  ■'  '~rs 


=    1  -    1  =0 

~n  "-n  ~n     X 1 


I-  o 

W    X,    =   W        [    ®      1         1  fn.       =      y    n.  / 

1=1         1.  J=l 


r  s 

W     [    9)      f    ®      1        111 
1=1      J  =  l         ij 


*      1  -      ®  I     ®     n.:   J         1         11 

.     ,    ~n.  .     ,     '-    ^  .    ,       ij       n.  .~n.  /    ~; 

1  =  1         1.         1=1  j  =  l         -"         ij       ij 
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r  s 


1  1 


i=l         i.         i=l  j=l        ij 


§      1  -      »      1  =0 

1=1         1.         1=1         1. 


Now,    the    matrix   X^   =    I     §      K 


Furthermore , 


j  =  l         Ij         j  =  l         2j  j  =  l         rj 


-1  ^      -1  ^      -1 

{&   n.  .  J  =   Diagf    ®   n,  .  J         ,    »  n^T  J 

.     .    ij    n  .  .  °^  .    ,    Ij    n,  .  '  .    ,    2j    n. . 


,    »  n    !j 
.    ,    rj    n    .' 


hence , 


"t^2 


=    [l  -      *      n.  ^    J        ]X„ 

n  .     .      11      n.  .  -^    2 


X„    -   {    »     n.^    J        }X„ 
2         '■  .     .      11       n.  .  ■'     2 


X„-[      ©(n,!j         1         )':    ®   (n„^J         1 

J  =  l  Ij       Ij         J  =  l  2j       2j 


;    ®  fn    ^J         1 
.     ,       ri    n    .~n    .' 
J  =  l  rj      rj 


x„  -  r  ®  r      :    ®  r      :...:«  r 

2        •■  .      ~n    .         .      ~n„ .  .    .^n    .■ 

j  =  l      Ij        j  =  l      2j  j  =  l      rj 


^2-^2  =  2n     xs' 


W   X_   =    W      [    §    1 
t    3  t    '-  .     .~n.  . 
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X^  -   ®  n.  .  J    1 


=  X-  -  »  1 
3    .  .~n.  . 


=  ^3  -  ^3  =  2- 


(ii)  We  know  from  Lindgren  (197b,  p. 333),  Theorem  3)  that 

V  and  the  residual  sums  of  squares,  C'  ,  are  statistically 

independent.   Now,  Y  =  G  y,  where 

G   =  Diagfn"!!'   ,  nTh'   ,...,n~h'   ).   Therefore,  G^Z>'  =  0. 
t       ^  ll~n,,    12~n,„      rs~n   ^  t  t  t   -^ 

11       12  rs 

But, 

Vt"t  =  2<->  ^t^j^ti^ti  ^^2«;2^  =3 


=>  VjH^^H'^^  -Ht2«'t2J»tl  =^° 


=>  G  E  H   =  0  .  (see  (3.77)) 

Hence,  Covfu  ,  H'  vl  =  G  Z  H  ,  =  0.    □ 
'     ^~t'   tl-^-^     t  t  tl 

From  lemma  3.7(i),  since  Wj.  =  H   H'   +  H  2^^^?'    ^^    follows  that 

ir  ,X,  =  n,  H',X^  =  0,  H',1    =0.   Hence, 
tl  1     '   tl  2    '   tl~n^^ 

Efw  )  =  0  (3.80) 

^~t    ~ 


and 


/ar(H',y)  =  o^l    ,       ,  , 
tl'^'     e  r(s-l) 


Consequently,  we  have 


Var(w   )    =   Var(y    )    +    (X        I    ,       ,.-'^J<^^  (3.81) 

~t  ~t  max    r(s-l)      t-'    e 
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Diag[(ra2+a2    )i      , ,a2    t  1    +    l  a^ 


+   [X^      1    ,       ,^-LJa2  (see(3.69)) 

^    max   r(s-l)      t^    e  ^  ^ 


=  Diag[fra2+a2  +x'^  a^)l      .,    [a^ .    +  X^        a^)l.       ,..   ,  ' 
'■  ^   3   a6   max  e^  s-1   ^  aS     max  e-'    (r-l)(s-l)^ 

Hence,  we  can  partition  w^.  into  w  ,  and  w  „  such  that 
~t      ~t 1     ~t/ 


-tl     s-l'-~'  *-   6    a3    max  e-'    s-n 
and  (3.82) 

~t2    (r-l)(s-l)'-~'  ^  ag    max  e^  (r-l)(s-l)-' 


Consequently, 


^tl        ~tl~tr     ^      3  a3  max   e-'        ^s-1 

and  (3.83) 

Qt2  =  ^;2^t2/    ^^a3   ^  'max^^    ^   4r-l)(s-l)    . 


Furthermore,  from  (3.81),  0  ,  and  Q|.2  are  independently 
distributed;  hence. 
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^1  =  ^ll   Xtl  /  ^^-1) 


~t2  ~t2  ^  (r-l)(s-l)  ' 


(3.84) 


can  be  used  to  test  the  hypothesis  H  :  a^  =  g  vs .  H  :  a^  ^t  0. 

op  a   cs 

Under  H  ,F^,  has  an  F  distribution  with  numerator  and  denominator 
o '  1 1 

degrees  of  freedom  equal  to  s-1  and  (r-l)(s-l),  respectively.   We 

reiect  the  H  at  the  a-level  of  significance  if 
-^         o 

^1   >  ^a,(s-l),(r-l)(s-l)'  ^^^'^  i«'  ^f  ^1  ^^"'^-'^^  '^^  "PP""^ 
alOO%  point  of  the  corresponding  F  distribution. 

Theorem  3.7 

The  vector  w  and  the  random  variable  Q^2   ^^^    independently 
distributed. 

Proof:   Recall  from  (3.78)  that  0^  =  Q^^  +  Qj.2,  where 

Qtl  =  ^'"tl^tl-^  ^"'^  ^t2  =  '^\2"t2'^-   ^'^  ^''°"'   "^^^^  ^   '^ 
independently  distributed  from  Q^2''    hence,  j^j.  =  ?C ^^   is 

independently  distributed  from  Q^2' 

Furthermore,  H^  ^Var(^)H^2";2  =  "tl^^2^2i  ^  ^^?aS  ^  '^^  "t2 


=  H'  H   a^  [see  lemma  3.7(i)) 

tl  t2  e  ^ 


=  0  [see  (3.77)) 


-73- 


But  this  implies  that  H'^  and  Q   are  independently  distributed 
(Searle  1971,  p. 59,  Thin.  3).   Since  (}^2    ""-S  independently 
distributed  from  jj   and  H'',^,  we  have  that  Qj_2  is  independently 
distributed  from  w  (see  (3.79)].      Q 
Consequently,  as  a  result  of  Theorem  3.7,  0^.2  is  independently 


distributed  from  w 


t2' 


Theorem  3.8 


^t2/a2    ^n   -2rs+r 
e 


Proof:   Q  ^  =  y'H  ^H'^y.   We  know  from  lemma  3.7  and  (3.71) 


^t2  =  ^   \2\2^ 


,-V2. 


But,  H^^H^z  =  »t2»;2^2"t2'  ^^"^^  "a»t2  =  ^n   '   ^^"'^ 


that  0^  '^H^2»'t2^"^^)  =  ^2»;2' 
But,  H^^H^z  =  »t2»;2^2"t2'  ^^"' 
is,  H  „H',-,  is  iderapotent.   Furthermore,  rank(Hj.2)  =  n..-2rs+r; 

hence,  from  Searle  (1971,  p. 57  Theorem  2),  Q^2/a2  ~  ^n   -2rs+r' 

e     •  • 
From  (3.83)  and  theorems  3.7  and  3.8, 


w'   w_  /  (r-l)(s-l) 
F   =  -^2   ~t2 (3^g5) 

a"   (l^/(n   -2rs+r) 
max  t2 
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can  be  used  to  test  the  hypothesis  H  :  a^   =  0  vs.  h  :  a^  t    0. 

'  ^  o        aS  a        a3 

Note    that    under   H    ,    F^o    has    an   F    distribution   with    nunnerator    and 

O        L  IL 

denominator  degrees  of  freedom  equal  to  (r-l)(s-l)  and  n, ,-2rs+r, 
respectively.  We  reject  H  at  the  a-level  of  significance  if  F^2 
>  ^a,(r-l)(s-l),(n..-2rs+r)- 

3.4.3    Derivation  of  an  Exact  Test  for  the  Fixed  Effects 

Consider  again  model  (3.62)  with  expectation  vector  and 

variance-covariance  matrix  defined  in  (3.63)  and  (3.64), 

respectively.   Let  A,  =  B , B'   i.e.,  A,  =  I  xJ  .   The  matrices  A, 
'        ^        llllrs  ^ 

and  At  (recall  A^  =  B^B'  =  J  xl  )  can  easily  be  shown  to  commute, 
2  2    2  2    r   s 

i.e.,  A,A„  =  A2A,.   Hence,  from  Searle  (1984,  p.  312),  there 
exists,  an  orthogonal  matrix  P   which  simultaneously  diagonalizes 
the  two  matrices.   Let  D   =  P  A  P   and  D  =  P  A^P   .   The 

•k  "k 

matrices  D,  and  Do  are  diagonal  matrices  whose  diagonal  elements 
are  the  eigenvalues  of  A,  and  A2,  respectively.   Now  as  pointed 
out  in  Thomsen  (1975): 

(i)   The  matrix  A,  has  eigenvalues  equal  to  s  and  zero 

with  multiplicities  r  and  rs-r,  respectively, 
(ii)  The  matrix  A^  has  eigenvalues  equal  to  r  and  zero 
with  multiplicities  s  and  rs-s,  respectively, 
and     (iii)  The  rank(A^+A2)  =  r+s-1.  (3.86) 
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Lemuia    3 . 8 

*  -  Vo 

The    first    row   of    P     can   be    chosen    to    be    (rs)      ^     V 

~rs 

Proof:   We  need  to  show  that  the  vector  J,    is  an  eigenvector  of 

both  A,  and  Ao  corresponding  to  eigenvalues  s  and  r 

respectively.   Note  that 

A,  1   =  (I   X  J  )l 
l~rs     r    s  ~rs 

=  1   X  si 
~r    ~s 

=  si 
~rs 

Since,  s  is  an  eigenvalue  of  A,  we  must  have  that,  1    is  an 
»  D  I  J  ~rs 

eigenvector  of  A,  with  eigenvalue  s.   Similarily, 


A  1    =  (J   X  I  )l 
2~rs     r    s  ~rs 

=  rl   X  1 
~r   ~s 

=  rl 


and  r  is  an  eigenvalue  of  A2,  hence,  J,    is  a  corresponding 


-  Vo 
tor  of  A.^.   Consequently,  (rs)   ^  J.    is  an  eigenvector 


eigenvecvjj.  yj>.    n..^ 
of  both  A,  and  A^ . 


D 


1    ''""    "2' 
Consider    the    tranf orraation 


ii      =    P^ 


(3.87) 
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The  matrix  P   can  be  partitioned  into 


P      =    L(rs) 


rs)      ^2     1'       : 


P         :    P         :    P 
rs  2  3  4 


(3.88) 


*  *  *        *^ 

where    ?2   consists    of    the    r-1    rows    of    P      such    that   P„A   P„      =   si   _, 

and    P„A^P„      =0.    _i-)^(    _,  \ !    P*    consists    of    the    s-1    rows    of    P      such 
that   P3A^P3   =   0(s_i)x(s_i)    ^nd    P3A2P3      =    rl^_^ ;    P*    consists    of    the 


*  *        * 

(r-1) (s-1)    rows    of    P      such    that   P,A,P,      =    0 


4  14    -(r-l)x(s-l) 


and 


P,A^P,   =0/   ,.  ,   ,..   Consequently,  we  can  partition  u   into 
\^    4    ~(r-l)x(s-l) 


*      r      *  -k'  -k"  *' 


u   =  [u  ,  u„  ,  U3  ,  u  J ' ,  where 


u*  -   NjM(rs)  ^2+  r^B^a,  ra2  +  02^  +  (rs)   ^^  [  j;  n^^]  ^2)  , 


i,J 


iJ2  ~  Vl^^Z^lS'  ^a3^r-l  ^  ^2^2  ^^  ' 


(3.89) 


iJ3  -  Vl^2.  (-1  ^  <3^^s-l  ^  P3^^3  ^: 


u,  --  N,   ,,,   ,,(0,  a2  I  +  p  KP  a2) 

~4    (r-l)(s-l)^~'   aB  (r-l)(s-l)    4   4   e^ 


Recall  from  (3.72)  and  (3.73)  that 


Q   =   yfy.  ,-y.  .12=  y'W  y,  where  W  =  I 
^t    .^,  ^  ijk    ii.'^    ^   f^'        t    n 
ijk   -^      -J 


.  .    n . .   IV 


Now  instead  of  using  the  partitioning  defined  in  (3.75),  consider 
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the  following 


A,  =  Diagfl   ,1,0     J  (3.90) 


and 


"f  =  t^Fl  =  «F2  •■    »F3]' 
where  v,  =  (r-1)  +  (r-l)(s-l)  =  s(r-l);  v^   =  n,  ,  -  2rs  +  s.   The 

matrices  Hp,,  Hp^,  and  Hp^  are  matrices  of  orders  n^ ^x[ s(r-l ))  . 

n^  ^x  j^n,  ^-2rs+s)  ,  and  n^^xrs,  respectively.   We  require  that 

n^^  >  2rs-s  .  (3.91) 

In  order  to  satisfy  both  (3.76)  and  (3.91)  we  will  need 

n   >  max[2rs  -  r,  2rs  -  s]  .  (3.92) 

Consider  the  random  vector  w  of  order  [s(r-l)]xl  defined  as 


w  =  S  /  +  (^    I   -  L.  ,)  '2h;   y,         (3.93) 
~    ~  2 : 4    ^  max  v     2:4^     F 1  -^^ 


where 


iJ2:4  =  LU2   =  ii4  J" 
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'l:k 


L^ 


*               -k' 

*           * 

*           * 

F 
max 


Lemma  3.9 


E  u 


2:4^ 


and 


P2  ^iS 


Varf u„  ,1  =  o^ ^\    ,      ,.  +  L„  ,a^ 
v^2:4^    a6  s(r-l)    2:4  e 


where  0  is  an  (r-l)(s-l)xl  vector  of  zeroes. 


Proof:   Let  P 


2:4 


*'      -k- 


We  have 


EIU2:4J  =  ^^^2:4  ^ 


=  P9.A  ^Ci) 


P„  ,  [ul    +  B.a 
2:4  ^  ~rs     1~- 
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2    1~ 


Var(u      J    =    P.,    ,{Var  ^  }p 


2:4 


=   P^    ,  \k^ai    +   Ia^„    +   Ka^    P 


2:4^    2 


a3  e^     2:4 


'22  24 


^24 


'44 


where 


^22   =   ^^^(ii2   )    =   '^aB^r-l   ^   P2'^^2 


^44   =   Var[u^ 


=   ^2 


a'^^I 


+   P/.KP.   al    , 


a6    (r-l)(s-l)  4      4      e 


and 


,    *  * 

^24  "   ^°^li32    '    ~4 


=    P„   A-P.    al    +   P_KP,    a2. 
2      2    4      3  2      4      e 


But, 


P^A^P*'    =    0    <=>    P^B^B?!'    =   5 


<=>  P2B2  =   0; 


hence,    P„A„    =   0.      Consequently,    Z„,    =   P„KP,    a^    and    therefore, 
22'-  24  24e 
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Var  u 


2:4^ 


r    *    ^ 
Var(u2    ) 

2      4      e 

P,KP„    ct2 
.    4      2      e 

Var(u*   ) 

=  a2  T 


a6  (s(r-l)) 


*   *'     *  *' 


P2KP2 


P2^^4 


:fc    ilf         *    *'' 


^^2 


^'^^ 


Theorem  3.9 


•^^al  ^   l^  +  L,  ,  a2  .  D 
aBs(r-l)     2:4   e 


E(w  ) 


'2   ^S 


and   Var(w  )    =    (a^ „    +  \^        o^]l    ,      ,. 
~     ^  a6    max  e-'    s(r-l) 


Proof:   e(w  )  =  e(u„  J  +  (a    I,  -  L„  ,)  '2  H;,E(y) 
v^  J  ^~2:4^    ^  max  v     2:4'^      Fl  ■^ 


=  e(u„  ,)  +  (x    I   -  L„  J  '2h;   [ul    +  X.  a; 
^~2:4-'    ^  max  v     2:4^^     Fl  ^  '"^,,  1  ~ 


Now  as  in  (3.78),  using  (3.90),  we  can  express  Q   =  ^'W  v  as 


\   =  ^'^"fI^'fI  ^  «F2";2^^' 
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that  is,  W^  =  H^^H^^  +  H^^H^^*   Furthermore, 


"pi  »Fi  =  ^'      ^""^    ^=^'2'3 


and 


"fI  "fj  =5.      for  i  ^  j  ; 


hence,  applying  lemma  3.7,  we  have  that  Ul      1   =  Hi  X  =  0. 
Consequently, 


E  w   =  E  u 


2-AJ 


^2:4^2 


•^2:4  =  ^^2  =  ^4 


P^B^a 


(since  P,A,  =  0  =>  P,B,  =  0) 
4  1         4  1 

(3.94) 


We  also  have  that  the  Cov[u   ,  ,  IC   y  )  ~  ^'  which  follows  from 
lemma  3.7(ii),  by  substituting  Hp,  and  Hpj  for  H™,  and  H„2 » 
respectively.   Hence, 


Var  w 


=  Var(u*  ,)+(A^   I   -L„  ,)  ^2h;  Var(v)H^,[A^   I   -L„  ,)  '2 
^~2:4'^  ^  max  u   2:4^     Fl    -^   Fl^  max  u    2:4^ 


=  Var(u*  ,)  +  (A^   I   -L„  ,)  ^2  h; 
^2:4^    ^  max  u   2:4^     F 1 


■x_x:a2  +  X„x:a2   +  la2]ti^.[x^      1        -L„  ,)  ^2  . 
■226     3  3  aS     e-'  Fl^  max  u,    2:4^^ 
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Again,  from  lemma  3.7(ii)  we  have  that  H'  X   =  Hi  X  =  0. 


Hence , 


Var(w  ]    =  Varfu-  ,1  +  [a^   I   -L_  .)a^ 
^~  ^  ^~2:4'^    ^  max  u   2:4^  e 


a^.l    ,      ,.  +  L„  ,a2  +  (x^   I   -  L„  .)a^ 
aS  s(r-l)     2:4  e    ^  max  u     2:4^  e 


=  (a2^  +  X^   a2)l  ,   ,,  .  (3.95) 

^  ap    max  e-^    s(r-l; 

D 
* 

The  random  vector  w  can  be  expressed  as 


w  =  P„  ,B,ct  +  P„  ,(a6)  +  P„  ,e  +  ( X^   I   -  L„  , )  ^2  r'   e.  (3.96) 
~     2:4  1~    2:4~     2:4~    ^  max  u    2:4^     Fl  ~ 


[Note  that  P2.4B2^  =  Q,    since  P2B2  =  P4B2  =  Q   from  (3.88)  and  the 
fact  thatP2A2P  2   '^  •S  ^^'^    ^U^2^   4  "^  -QO   Let  X  and  e   be  defined 


*    * 

^  =  ^2:4^ 

(3.97) 

e*  =   P„  ,(a6)  +  P„  ,  e  +  fx^   I  -L„  ,)  '  2  h'   e, 
~     2:4~     2:4~    ^  max  u   2:4-"     Fl  ~ ' 


respectively.   Note  that  e  ~  n[0,  ( a^ „    +   X    a^]l    ,       , J 

~     '-~'  ^  aS    max  &'    s(r-l)-' 

From  (3.96)  we  have 
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w  =  X  a  +  e 


(3.98) 


The  generalized  least  squares  normal  equations  for  obtaining 
the  estimates  of  the  elements  in  cc  of  (3.98)  are 


*'  r         *   1  -1   *  n       *'  r         *  T  -1   * 

X   [Var(w  )]   X  a   =  X   [Var(w  )]   w 


(3.99) 


<=>  X  X  a   =  X  w 


Lnce   Var(w*)    =   fa2      +  x^      a^)l    ,       ,..      Solving    (3.99)    for  a°  we 
~  *-    aS  max   e-'    s(r-l)  ^  ^ 


obtain 


a      =    IX     X    )      X     w      . 


(3.100) 


Consider  testing 


H  :   R  a  =  m   , 


(3.101) 


where  R   is  a  full  row-rank  matrix  and  R  3  is  a  set  of  estimable 
linear  functions  of  the  elements  of  a;  W   is  a  vector,  of  order 

•k  ^ 

(g=<l)  (g  equals  the  row  rank  of  R   ) ,  of  specified  constants.   Let 


R  a   -  m   . 


(3.102) 
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From  (3.100)  and  the  fact  that  R  a  is  an  estimable  linear  function 
of  a,    we  have  that 


EH    )  =   R  a  -  m 


Var(£  )  =  R  G  ^R  (a^„   +  X        a^)  , 
~a         *   ^  a3    max  e-^ 


where  G  ^  =  fx  X  1  . 


(3.103) 


It  follows  from  Searle  (1971,  p.  57,  Theorem  2)  that 


Q   =  £   I R   G  .R  J  '  £  /a 


X2'[g,  (r*  a-m*)rR*  G  .R*)  ^(rVh!*)/^^* 


(3.104) 


*2     ,     F   , 
where  a       =  a^  „   +  X        a'^ .      Now  consider 
ap    max  e 


SSE   =  w  w  -  a   X  w 


*,  *'  *,_*'.  * 


=  w    I 


;(r-l)  "  ^  (^^  ^  ^  ^   ^^ 


(3.105) 


Theorem  3.10 
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SSE*/a*'  ~  X2^_,)(3_i) 


Proof:   The  matrix  (l    .         .  -  X  (X  X  )   X   1  is  idempotent; 


hence, 


"s(r-l) 


*   *'  *  _  *^ 


ranki  I  ,   ,  ,  -  X  (X  X  )   X 
"■  s(r-l) 


=  tracefl  ,   , ,  -  X  (X  X  ) 
^  s(r-l) 


X 


=  rankf  I  ,   i\l  -  rankfx 
^  s(r-l)^       ^ 


=  s(r-l)  -  rank(X  ). 


Bu 


t,  rank(X  )  =  rank(p    B  ) 


=  '^^"KP2:/iP2:4^ 


=  rank{Diag(sI^_^,  0^^_^ )(^_^ ))} 


=  r-1. 


Hence,  rankj"  j      -X  (X   X  )"  X   )  =  s(r-l)-(r-l)  =  (r-l)(s-l), 


*   *'  *  _   *' 


Furthermore,  [e(w  )]'[i  ,  _n~X  (X  X  )   X   ][e(w  )]  =  0. 
Therefore,  from  Searle  (1971,  p. 57,  Theorem  2), 
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SSE*/a*'  -X2^_,)(3_i).    D 


It  can  easily  be  shown  that  Q^  in  (3.104)  and  SSE   in  (3.105) 
are  independently  distributed  (see  analogous  proof  in  Theorem 
3.4).   Hence,  from  (3.104)  and  Theorem  3.10,  we  have  that 


^a  ^^   ^  *^  ^    ^J^ 

F  (H)  =  J— ^ (3.106) 

SSE  /(r-l)(s-l) 


~  F'[g,  (r-l)(s-l),  (r  a-m  )(r  G  ^R  )  ^( R  a-m  ) /2a   ]. 

X 


Under  the  hypothesis,  H  :   R  a  =  m  ,  the  noncentrality  parameter 

"k  -k 

is  zero  and  F  (H)  ~  F   (r-l)(s-l)'  i*^**  ^  ^^^  ^^^  ^  central  F 
distribution.   Therefore,  F  (H)  provides  an  exact  test  for  H  .   In 
particular  we  can  test  the  hypothesis  H  :  a,  =  32  =  •••  =  ci  . 

In  the  following  table,  three  machines  (the  fixed  effects)  in 
a  company  are  to  be  compared  in  terms  of  their  speed  in  using  a 
particular  component.   Four  employees  (the  random  effects)  are 
randomly  selected  to  participate  in  the  experiment.   Each  employee 
is  to  operate  the  machine  three  different  times  and  an  overall 
score  which  takes  into  account  the  number  and  quality  of 
components  produced  is  recorded.   At  the  end  of  the  study  we  are 
left  with  the  following  data: 


-87- 


Table  3.2   Example  of  an  Unbalanced  Two-Way  Cross  Classification 

Mixed  Design  (Source: Miliken  and  Johnson  (1984, Table 
23.1,  p.  285)) 


Machine 


Person 


time  1 


time  2    time  3 


1 

1 

52.0 

1 

2 

51.8 

52.8 

1 

3 

60.0 

1 

4 

51.1 

52.3 

2 

1 

64.0 

2 

2 

59.7 

60.0 

59.0 

2 

3 

68.6 

65.8 

2 

4 

63.2 

62.89 

62.2 

3 

1 

67.5 

67.2 

66.9 

3 

2 

61.5 

61.7 

62.3 

3 

3 

70.8 

70.6 

71.0 

4 

64.1 

66.2 

64.0 

Note  that  we  have  an  unbalanced  design  (some  of  the  data  has  been 
randomly  deleted  to  illustrate  this  design).   Using  the  program  in 
Appendix  F,  we  test  the  fixed  main  effect  and  the  variance 
components  associated  with  the  random  effects  (main  and 
interaction  effect). 


Table  3.2  -  continued 
Results : 

For  testing  H^  :  a2g/a|  =  0 

test  statistic  =  45.70  with  numerator    df  =  6, 

denominator  df  =  6 
p-value  <  .0001 

For  testing  H   :  al/a'^    =  0 
"   o    D   e 

test  statistic  =  1.94  with  numerator   df  =  3, 

denominator  df  =  6 
p-value  =  .224 

For  testing  the  fixed  effects:  H  :  a,  =  a9  =  ao  vs  H  :  not  H^ 
test  statistic  =  12.09  with  numerator    df  =  2, 

denominator  df  =  6 
p-value  =  .008. 

Since  the  interaction  appears  to  be  significant,  we  have  to 
analyze  the  fixed  effects  for  each  level  of  the  random  effects. 
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3.4.4   Reduction  of  the  Exact  Tests  When  the  Design  is  Balanced 

In  this  section  we  investigate  the  situation  where  model 
(3.60)  is  defined  for  i=l,2,...,r;  j=l,2,...,s;  k=l,2,...,n,  that 
is,  we  have  a  balanced  design.   We  need  to  show  that  the  derived 
exact  tests  reduce  to  the  conventional  test  statistics  employed 
under  a  balanced  situation. 

A.   Reduction  of  the  Exact  Tests  for  Testing  the  Variance 
Component  associated  with  the  Random  Main  Effect 


Recall  from  Section  3.4.1  that  for  testing  the  H  :  ai  =  0  vs. 
H  :  a?  ?^  0,  we  derived  the  test  statistic  defined  in  (3.84), 


'tl    w^^^tZ^'^""^''^^'^^  ' 


From  Khuri  (1982),  the  corresponding  conventional  F-test  employed 
when  the  design  is  balanced  can  be  written  as 


F.  = 


rPz'X/^^-^) 


3   ^'^3^/(1^-0(3-1)' 


(3.107) 


where 


-1, 


I   xj 
rs   n' 


^I  xJ 


sn^  r   sn' 


— J  XI  xj 
rn^  r   s   n^ 


-^—   J       (3.108) 
rsn   rsn 
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and 


P„  =  (J  XI  xJ 

2   rn^  r   s   n^ 


J 

rsn   rsn 


Theorem  3.11 


Fj^2  ~  Ft  when  we  have  a  balanced  design. 


Proof: 


From  (3.79), 


w  =u   +fx'^   I,   ,,-Ll'2H'y. 
~t   ~t    ^  max  r(s-l)     t-'  tl-^ 


Now  L^  =  PC^KC'P',  where  K  =  Diagfn,^  ,  n,i  ,  ....  n  ^ 
c     t   c  ^'-  11     12         rs-' 


When  we  have  a  balanced  design  n..  =  n  V  ..,  hence,  the  matrix  K 
reduces  to  n  I^^.   Now,  recall  that  X„„^  is  the  largest 

r  S  Tu3X 

eigenvalue  of  L  ,  but,  for  the  balanced  design, 

L  =  PC  {n~^I   JC'P'  =  n'^PC  C'P'  =  n~^I   . 
t     t^     rs^  t  t  t         rs 


t   =  „-l 
'max 


Hence,  A^   =  n   .   Consequently,  when  we  have  a  balanced  design. 


w  =  u   =  FC  y 
~  t   ^  t     t-^ 


(3.109) 
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It  follows  from  (3.82)  that  y^^   can  be  partitioned  into 


w^,  =  P   C  V  and  w_  =  P^^^Cv 
~tl        f^     "t2        f^ 


where    P^    ^    consists    of    the    s-1    rows    of    P    such    that    P^^C  A^C'lP^-'-^ 
=    '^Iq-i    3"*^    P  consists    of    the    remaining    (r-l)(s-l)    rows    of    P 

such    that    P'^"^C^A2C^P^^^      =   Q   (the   matrix  Q   is    of    order 
[(r-l)(s-l)]x[(r-l)(s-l)] .)      Note    that 


;  A.c;   =    fl      X    T)fj     X    I    Ifi      X    T'l  fx   defined    in    (3.66)' 

t/t^r  ^^r  s^^r  ^  ^  ' 


=     J     X    T      I      X    T' 


=   J     X    XT'    =   J      X    I         . 
r  r  s-1 


Furthermore,  consider  the  matrix  f —  1   x  I   1.   We  have  that 

^  / r  s-y 

/r 


[—  r    X    I      Jc  A„C'(—  1      XI      J    =    rl      , 

/— ~r  s-P    t   2    t    / r  s-F  s-1 

/r  /r 


hence,    P^        can    be    chosen    to    be    the   matrix   f —   1      x    I        1  . 

^  / r  s-V 

/  r 

Consequently, 


.u«u  =  rc-,p<»-p">c,^ 


-92- 


=  /(I    X  r)(—  1    X  I     )(i-  r 


X    h-l}l\^    TJ^ 


1    - 


=  7^'^^r'   ^'^^-^r   '    Vl^^^r  "    ^^-^ 


7?[J^  X   rx]^ 


1    - 


r-*      '■r  «        «      ci-/  ''Z 


S  S        S' 


(see   Appendix    D) 


Now, 


,i      L  J-   I    J-  gJ         rs    ^    r  s^-''* 


=  n~V[l     ^    i   )[-  (-J  >*    I  }    -  —  (j  X   J  llfl     X    I'Jy 
-^    ^    rs     ~n^'-r    ^    r        s'^         rs    ^    r        s^  ■' ^    rs     ~n'^'^ 

=    -r[—    (j    X     I    X     J     )     -    J_    J  ]y 

n  -*    '■  rn   ^    r        s        n^         rsn      rsn-''* 


^'Vp2^- 


~tl 

^t2 


hence, 


^t^^t  =-5ftAi  +^;2:5?t2'     ^^^'  ^"^ 


w'"„w  „    =  w'w     -  w^,w    ,. 
~t2~t2        '-t~t        ~tl~tl 
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But,  w'w      =    y'C'P'PC    y 


=  rc;c^^ 


=  ^  ii^><  i  jii/  ij^ 


r(l/    T-T)^ 


n     _;^'(I      X    1    KlxT'TKl      x    1 


rs     ~n' ^    r 


rs     ~n^'^ 


-2 


=   n      v'fl  X    T'T  X    1    Ifi      X    I'ly 


-2 


=   n     y(l   X    ri  X    J    )_^ 


=    n      y'["l      xfl jlxjly 


r        ^    s        s      s'  n-' 


=   n  V[(l      X    J   )    --  (I   X    J      )]y.  (3.110) 

■^    '■  ^    rs        n^         s    ^    r        sn^  ■''* 


Hence , 


-1    ,r    -1 


Wt2~t2   "   "     -^  '  "      '  •■■      ""    '^ 


[n"^(l      X    J    )    -i_(l   X    J      )]y 
'•         ^    rs        n^         sn^    r        sn^-'-^ 


"    Vp2'J^ 


n'V[""^(l      ^    J 


)    -^I   X    J      )     -    P   1^ 
n^         sn^    r        sn^  2-''^ 
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Note  from  (3.108)  that 


P.  =  n  Vl  X  J  )  -  i_  (l  X  J   )  -  P„, 
3      ^  rs    n^    sn  ^  r    sn^     2 


therefore, 


Consequently, 


^t2:St2  =  "'^^'^3^- 


ii'tl^'tl/^^-^) 


tl       w^2Jit2/'^'^~^^'-^"^'* 


-1 


=  ^3  • 


',.      Reduction  of  the  Exact  Test  for  the  Fixed  Effects 


From  (3.93) 


w   =  u     +  [X    I   -  L    JHI  y, 
~    ~2:4    '■  max  v     2:4^  Fl-^ 


where,  (v^  =  s(r-l)) ; 
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2:4 


P2KP2 


^2^4 


A    =  largest  eigenvalue  of  L-,-. 
max      *      ^  2:4 


When  we  have  a  balanced  design  the  matrix  K  reduces  to 


r  ,s 


-1    I        -1     -1. 


K=»n..=   en    =nl, 
.  .   11    .  .  rs 


(3.111) 


Hence,  the  matrix,  Lo.a,  reduces  tc 


-1 


'2:4 


*  *^ 

P  P 
4  2 


PnP, 


2  2     2  4 


P  P 

4  4 


(3.112) 


=  n-4 


s(r-l) 


(see  (3.88)) 


F      -1 
Consequently,  X    =  n   ,  and  therefore  when  we  have  a  balanced 
max 

design,  then  j^  becomes 


'2:4 


(3.113) 


=  P„  ,B,a  +  P„  ,(,a3)  +  P^.^e. 
2  :  4  1~    2:4^      2  : 4~ 


Proceeding  as  in  (3.97)  we  again  have  X  =  P„  ,B.,  but  nc 
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4  =  ^*2:d^1^^    ^i^' 


(3.114) 


Note  that  Var(e  )  =  I(a  n  +  ri  a^ )  J  and  we  can  express  (3.113) 


w   =  X  a  +  E 


(3.115) 


Recall  from  (3.106)  that 


*-  .     -k-  *s-l  * 

I      [R  G  ^R  J  I    li 


F  (H)  = 


SSE  /(r-l)(s-l) 


was  the  test  statistic  derived  to  test  the  H  •  R  a  =  m  .   We  also 

recall  that  i        from  (3.102)  and  SSE   from  (3.105)  are 
~a 


and 


Lemma  3.10 


I      =   R     a     -  m 


SSE   =  w   (I  ,   ,  v-X  (X   X  )   X   Jw 
~   ^  s(r-l)  ^~ 


When  we  have  a  balanced  design 


F*(H)  =f" 


MSaB  ' 
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when  g  =  r-1  and  m  =  0  (see  (3.106)),  that  is,  when  the 
hypothesis  to  be  tested  is  R  a  =  0,  and  g  equals  to  the  maxiraum 
number  of  linearly  independent  estimable  functions  of  a. 

Proof:   When  we  have  a  balanced  design 


^^^      =Ji2:4(^s(r-l)-^  (X   X  )  X  ]v,.^ 


Now,  X   X   = 


^?2:4^:4^-   ^"^'  ^2:4^2:4  =  ^rs'^lrS^rS  '  ^^"^•^' 


^1^2:4^2:4^ 


'?1  "  ^?1:3^1:3^1 


I  xl'J  I  xl 
r  ~S'^  ^  r  ~s' 


irf 1   :P„ 

1^  , —  ~rs   3 
/rs 


1 
/rs 

i 
P, 


=  si  -  b;  ( —  J  +  p^  PqJb,. 

r    1  ^rs   rs    3   3^  1 


Recall  that  P„  consists  of  the  s-1  rows  of  P   such 

that  P^A,  P.  =   0.      ,.  ,   ,..   Hence,  P.B.B'P^   =  0,  that  is, 
3  1  3    ~(s-l)x(s-l)  3  113 

Consequently,   b'P^  ,P^  ,B,  =  sI   -  Brf J   )e, 

12:42:41     r     l^rs  rs   1 


=  si  -  —  (s2j  ) 
r    rs  ^    v' 
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=  si J 

r    r  r 


=  s[l   -  -  J    . 
V  J.    r   r^ 


Note  that  (l      -  -  J    )(l      --jl=I   --J,  that  is, 
^  r    r   r^^  r   r   r^     r    r   r 

I   J   is  an  iderapotent  matrix.   From  Graybill  (1983,  p. Ill, 

Theorem  6.2.14),  f I   -  -  J  ]~  equals  (l      -  -  J  1  .   Hence, 
^rrr^         ^rrr^ 


Now, 


'X   X*l   =  [s(l   -  -  J  ' 
J  "■  ^  r   r  r- 


s  ^  r   r   r^ 


(3.116) 


*   _  *^ 


*   *'  *  _  *^,  *  _ 


SSE  =  ^P2:4^^s(r-1)"  ^  ^^  ^  ^  ^  ^^2:4^ 


where 


=  -^'^^2:4^2:4  "  ^2:4^  (X  X  )  X  P^^^)^. 


P„  ,X  =  P.  ,P„  .B,  =  [I    -  P,  „P,  JB, 
2:4      2:42:41    ^rs     1:31: 3^  1 


i, J   B, 

1    rs   rs  1 


I  xl     _  J.  f  J  xl  1 

r  ~s^    r  ^  r  ~s^ 
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Hence, 


P„    ,X    (X      X   )    X      P,. 


2:4 


2:4 


I  XI    )    -i  (J  xl    )][!  (I     -i  J   )]x*'p*    , 
r  ~s^         r   ^    r  ~s'^-''-s    ^    r        r      v' ■'  2:4 


[-^  [I     -^  J  )xl    ]4i-(j  -J   )xl    ]}x*'p*   , 


tl    r  1         ^  ,     *'    * 

-I      -  -  J      xl      X      P„    , 
^s    ^    r        r     r^   ~s^  2:4 


=  {i  (I    -ij  )xi  }{(i  xr)  -1  (j  xr)} 


-  fl     --J   )xj     -   0 

s    ^    r        r   r^      s       ~rsxrs 


i  (I      -^  J    )xj    . 
s    ^    r        r      r^      s 


(3.117) 


We   have 


SSE     =    y  fP„    ,P„    , fl J   JxJ  Jy 

-^   ^    2:4    2:4        s    ^    r        r      r^       s^-^ 


=  rK]/2-A}-ir[i\  -T-^r^-^s]^ 


Now, 


w      [X    (X      X    )    X      Jw 


=  ^^2:4^*^^*  ^*^    ^*  ^2:4^ 
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-7r^^\-7\>'l~^ 


see    (3.117)) 


in^    /<,      1-  ^    rs     ~n 


I     X    1    )    fl      X    J    )    -  -J  I__   X    1- 


r  s^         r   rs'  ^    rs        ^n-' 


-  r[—  (I  X  J   )  -^- J     ]^ 

n  ■^    '■sn    ^    r  sn^         rsn      rsn-''* 


=  -  SSa      [see   Khuri    (1982); 


(3.118) 


But, 


w      fx    (X      X    )    X      jw 


ytP^    P2B^(X     X   )    BJP^    P2]^ 


_     ^     *'     A         ,     *^     A._  A'     A     - 

^[P^    P2B^(X      X   )    B^P^    P2]j 


since    P.  B,    =0 
4    1        ~ 


=  ^y[p*'p*(l   xl    )[l    -Ij    )(I  xr)p*'p*]^  (see(3.116)) 
s  ■^    '-    2      2^    r  ^s-^^    r      r   r^^    r  ~s^    2      2-''^ 


1     _  A'     A  1      ,  A'     A- 

7r[^2   P2KV^s)    -7('Jr'^'Js)JJ^2P2^ 
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l    -      *^        * 


7fh    liP2(V^s)^2    J    -7iP2^V^s^^2   l^V 


-  y'p„  [si    ,  -  -  {p„fi  XI  Ifrxj  )p„}1p^v 


since,  I  xj   =  A,  and  P„A,P„   =  si  ^] 
'   r   s    1      2  12      r-r 


f^2   h^ 


I        X  I 


5^  and  P^B^  =  ^j 


Hence , 


_   ^'*  ^_    1 

yP2  V  =  n  ^S°" 


(3.119) 


Now,  recall  that  the  r-1  rows  of  P   are  the  coefficients 
associated  with  orthogonal  contrasts  involving  the  levels  of  a. 
Similarily,  the  (r-l)(s-l)  rows  of  P^  are  the  coefficients 
associated  with  orthogonal  contrasts  involving  the  levels  of  op 
Analogously,  we  must  have 


rCv  =  n  ss"^- 


(3.120) 


Furthermore, 


c-iLV-r-     T-    Y-J  aJ'O 
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-   y'fl   xj      -  -J      )y 
s  -^    ^    r      s        r    rs^-^ 


=   -U-y'ri       xl     Ifl    xJ       --J       )(l       xr)y 

=   -    y'[—    [I    xJ    xl     1     -   -^    fj       xl    )](l       xr)y 
n  -^    ^sx\    ^    r      s  ~n^         rsn    ^    rs  ~n^ -^  ^    rs  ~n^'^ 

=     1     y'[i_     (I     XJ      XJ      )       -     -L-     J  ]j 

n  -^    '- sn   ^    r      s      n-^         rsn      rsn-'-^ 


=  -  SSa  (see   Khuri    (1982)1. 


(3.121) 


From  (3.117),  (3.118),  (3.120),  and  (3.121)  it  follows  that 


SSE*  =  -  fSSa  +  SSaS  -  SSa]  =  -  SSa6 . 


From  Searle  (1971,  p.  199)  and  under  the  assumptions  that  g  =  r-1 

* 

and  m  =  0, 


i      (r      G  ^R  1   a   =  w   fx  (X   X  )  X   Jw  , 


and  from  (3.118)  we  have 


i      (r     G  .R  1   £   =  _  SSa. 
~a  ^      *   >   ~a   n 


From  the  above  results,  it  follows  that  when  we  have  a  balanced 
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design  and  g  =  r-1  with  m  =  0  , 


-  (SSa)/g 


F  (H)  = 


-  (SSa)/(r-l)(s-l) 


SSa/(r-l) 


SSa8/(r-l)(s-l) 


MSa 
MSaB 
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3.5  The  Design  Parameter  and  the  Power  of  the  Test. 

We  will  define  X    ^^,    x'-„,  ,  and  Xl^^   as  the  design  parameters 
max'   max'      max  °  ^ 

associated  with  the  test  statistics  defined  in  (3.50),  (3.84),  and 
(3.106),  respectively.   The  reason  for  using  this  terminology, 
"design  parameter",  will  be  clarified  in  the  discussion  that 
follows. 

3.5.1     Design  Parameter,  X 


Consider  the  test  statistic  F(H),  defined  in  (3.50),  to  test 
the  fixed  effects  in  a  2-fold  nested  mixed  model  as  pointed  out  in 
Section  3.3.2, 

F(H)  ~  F'  [s,m^-a,(R'£  -  m)'(R'G  R)~\r'£  -  ra)/2a   ], 


where  a   =  a?  +  X    a^ .   Since  the  power  of  a  test  is  an 
increasing  function  of  the  noncentrality  parameter,  the  power  of 
our  test  is  a  decreasing  function  of  ^^g^*   Note  that  the 


parameter  X  is  directly  associated  with  the  design,  since 


X     =  raaxfX:  Ik-XiI  =  Ol ,  where  K  =  Diagfn,,,,,  n  ,  ,,  ...,  n 
max       ^    '     '  ^     i.{L)         H.I ) 

Hence, 


-1 

m  (a)' 


X    =  maxix  :   II   f  n  .  ,  .  , 
max      ^    .  .  ^  j(i) 
1  >J 


-  Xl  =  0} 


-105- 


raaxf  X  :    A   =    n.,..    forV..! 


-I      ^        r    •    r  ^i-l 


=   maxfn.,..)    =   fminf n. , . . 1 1  V..    •      (3.122) 

^    j(i)^         ^         ^    j(i)^^  ij 


Furthermore,    we    can    find   a    lower   bound    for  A 


Lemma    3.11 


—     L      n  .  /  .  ,       <    A 

m      .     .       u 1 )  max 


ill    m      =      y      m.  J  . 
.     .       1 


Proof:  [rainrn. , . , 11         >   n.,..  w-- 

i-         ^    j(i)^J  j(i)   ^  ij 


=>      y    [minfn. . . ^l]         >      J    n. .  . . 
^  >  J  -■•  >  J 


-1 


=>A  m     >      yn.,., 

max      •         .  ^  .    J  ( 1 ) 


1         V      -1 
Hence  ,  A  >  —     )    n  .  .  .  . . 

max        m      .     .     i (i) 
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3.5.2    Design  Parameter,  X 


Consider  the  test  statistic  F  ,  defined  in  (3.84),  for 
testing  the  hypothesis  H  :  oi  =  0,  where  ai  is  the  variance 
component  associated  with  the  random  main  effect  in  the  two-way 
cross  classification  model.   The  power  associated  with  this  test 
can  be  expressed  as 


^^^s-l,(r-l)(s-l)  ^  ®  ^a,s-l,(r-l)(s-l)- 


(see  4.31) 


where  9  =   (l  +  [rai/(a^,    +  X        a^] 
^  '■   b  ^  ab    max  e^ 


-1 


Hence,  the  power  of  F^ 


is  a  decreasing  function  of  ^ma„.  where  ^^.g^  is  the  largest 
eigenvalue  of  the  matrix  L  and 


L   =  PC  KC'P'. 
t     t   t 


The  matrix  P  is  an  orthogonal  matrix  whose  rows  are  orthonormal 
eigenvectors  of  the  matrix  C  KC' .   The  matrix  C   was  defined  as 
I  xT,  where  T  is  defined  in  (3.66),  and 
K  =  Diag(n;j'^,  n^^'  •••'  ^g)  • 

Since  the  power  of  F  ,  depends  on  ^^gx'  ^^^    following  lemma 
is  an  important  result. 


Lenima  3.12 
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-7—  )  n..  <  A    <  — : -, r. 

r'^s  ^      11     max   run  (n.  ; 


i,J 


Proof:   Let  e*"   (A)  equal  the  largest  eigenvalue  of  the  matrix 
A.   Since  P  is  an  orthogonal  matrix  then 


e*^   I  PC  KCP']  =   &        Z   KC  , 
max*-   t   t   ■'     max  t   t 


Let  n^  =  min(n.j)  v^j 


We  know  that  C|.C^ 


-1 


I  xTT" 


r(s-l)' 


Hence,  it  follows  that  the  matrix  n   C  C  -  C  KC'  is  positive 
'  m   t  t     t   t     ^ 

semidefinite  and 
therefore , 


^t   ,  -1 
'max 


n  ^C  C'l  >    e^      (C  KC'}  =  X '^   . 
m   t  t-^     max^  t  V  max 


5ut,  e^   (n  ^C^C;] 
max^  m  t  t^ 


=  e    fn   I  .   ,n1  =  — ,  that  is, 
max^  m  r(s-l)'^    n 


1     >  X^ 


min(n. . )     max 


(3.123) 


Furthermore, 


^    tr(C.KC: 


r(s-l)  ""^"t   t^    r(s-l) 


1      '^(r^)  t 


i=l 


where  X?  are  the  eigenvalues  of  C^KC..   Hence,  —. r-r  EX.  is  the 

1  ^  t   t        '  r(s-l)    1 

average  of  the  eigenvalues  of  C.KC,..   Since  X^^^  >  —7 r-r  ZX  .  , 

°  ^  t   t  max   r(s-l)    1 


then 
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A*^        >      /    ■-    trfc    KC'l  . 
max        r(s-l)         ^    t      f' 


(3.124) 


Now, 


trl'c   KC'l    =    trfc'C   k) 


=    tr{(l    x[i      --J    ])k}    (See    appendix    (D)) 


r   '■    s        s      s 


From    (3.122) 


tr    I      K I  I   xj    JK} 

^    rs  s    ^    r      s^    ■' 


tr(K)    -^  tr[(l^xjjK] 


.     .    n. .         s    ..    n.. 


t  1  r      V        -1  1        V         "ll 

max        r(s-l)'-.     .    ii         s    .^.    ij-' 


1  (s-1)     y        ^-1 

r(s-l)        s        ^ .      i i 


1    V        -1 
—  )      n. .     . 
rs    v  .      11 


(3.125) 


The    proof    of    lemma    3.12    follows    from    (3.123)    and    (3.125)         D 
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3.5.3    Design  Parameter,  A 


The  power  of  the  test  statistic  used  for  testing  the  fixed 

effects,  F  (H),  also  depends  on  a  design  parameter.   To  see  this, 

recall  from  (3.106)  that  the  parameter  \  is  equal  to  the 

^  max     ^ 

largest  eigenvalue  of  the  matrix  Lo-A  ~  ^9.a'^9-a*   Hence,  the 
following  lemma  is  an  important  result  when  we  consider  the  power 
of  this  test. 


Lemma  3.13 


J_rl   y    -1 I ■ 

r-l  •■  s  .  .  n  .    min(n   )- 


i.J 


max   min(n  . ) 


Proof:   Let  ef,ax^^^  ^^  ^^"^  largest  eigenvalue  of  the  maxtrix  A  and 

•k  *'* 

"m  =  min(nij)Vij.   Then  72-a'^2:U    "  ^s(r-l)'  hence, 

-I     *  -k"  *      *' 

n   P„  , P„  ,  -  P„  , KP„  ,  is  a  positive  semidefinite 

m      2:4    2:4  2:4      2:4 

matrix,    and    therefore,    e        fn      P„    ,  P„    ,  1    >    e        fp^    ,  KP^    ,1.      But, 

raax^    m      2:4    2:4^  max^    2:4      2:4-^ 


e        (n      P.      p        J    =   e        (n      I    .       ,  J 
raax^    m     2:4    2:4^  max^    m      s(r-l;^ 


-4-   (n..) 
min         ij 


-1  10- 


Consequently, 


—r-   (n.  .)    >    X 
mm        ij  max 

F  i«  i  *  *"* 

Now,    let   A^    denote    the    itri   eigenvalue    of    Po./.'^^?./,*      ■'-'-    folic 

that 


F  1  V    F  1  r    *  *'    ■ 

\  >  ~, TY  Z^  •    =  —I rTtr(P„    ,KP„    , 

max        s(r-l)    r    i        s(r-l)      ^    2:4      2:-f 


1  r    *'      *        ^ 

Ttrfp,    ,P,    ,K) 


s(r-l)      *-    2:4    2:4 


r^— -r-tr[(l    ,       ,-    -    P,    „P,    „)  k] 
r-1 )      '■^    s(r-l)  1:3    1:3-^    ■' 


1  r  *'      *        -, 

—. rr-tr  K  -   P,    _P  ,    „K 

s(r-l)      ■•  1:3    1:3-' 


s(r 


?:iT^^^^)  -  Tih^'-^^Ji-.z^^   ' 


Now,    trfP,    ,P,    .k1    =    trfp,    _KP,    „)    and   P,    ,P,    „    =   I    ,    hence, 
^    1:3    1:3   ■'  ^    1:3      1:3-^  1:3    1:3  s 


-1    *        *'  *  *' 

n      P.    „P,    .    >    P, ..KP 
m      1:3    1:3  1:3      1:3 


(that  is,  the  difference  defined  as  the  left-hand  side  minus  the 
right-hand  side  is  a  positive  semidefinite  matrix).   Therefore, 


1 1 1- 


sn"^    =    tr(n:^*    -P*    J    >    tr[P,  .KP,., 


m      1:3    1:3' 


1:3      1:3-' 


*  *'      ^  -1 

-    tr(p,    -KP    ,    _)    >    -sn      . 
^1:3        1:3^  m 


Consequently, 


F  1  1  ^    *  *'    > 

X  >   —. p-tr(K)    -  —. TTtrtP,    ,KP,    ^ 

max        s(r-l)  s(r-l)      ^     1:3      1:3^ 


We   have 


s(r 


1 y       _l 1 1 

r-1)    .'^  .    n  .  .         (r-1)    min(n.. 


.) 


1     r  1 


r-l'-s    .     .    n.  .         min(n.  .  )■'  i 


i(n.  .  )■'  max        min(n,  .  ) 


CHAPTER  FOUR 
POWER  STUDY 


4.1  THE  2-FOLD  NESTED  MIXED  MODEL  POWER  STUDY 

4.1.1     Introduction 

Consider  again  the  unbalanced  2-fold  nested  mixed  model  in 
(3.21).   The  analysis  of  variance  table  is  expressed  as  follows: 


Table  4.1   Type  I  Analysis  of  Variance  Table  for  the  2-Fold  Nested 
Mixed  Model 


Source 


Degrees 
of  Freedom 


Mean 
Squares 


Expected 
Mean  Squares 


Nesting  Effect  (a)  f. 
Nested  Effect  (g)  f2 
Error  f^ 


lS(a)    =  YQij/f,        Q(a)+£, a2+0^ 


MS(0|a)    =  /Q2j/f2 


2   b     e 
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where 
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f,  =  a-1,  f   =  m  -a,  and  f   =  n  -ra  ; 


Q,  =   ®  [-  J    )  -  -  J 
1    .,n.   n.^    n   n 
1=1   1.   1. 

b. 
a     1     1  1 

Q„  =   ®   {  ®  — - —  J      -  - —  J   } 

1=1   j  =  l   j(i)  j(i)     1.    1. 


and 


^3  =  I     -   §  J 

3    n     .  .  n. , . ,   n. ,  .  ■ 


Q(«)  =  [E(v)]'QjE(v)]/f^ 


i=l    i.     i=l    i. 


Note  that  the  above  table  is  based  on  the  type  I  suras  of  squares 
analysis  in  SAS  (1985).  When  testing  the  nesting  effect  in  a  2- 
fold  nested  model  only  the  type  I  sum  of  squares  are  appropriate. 

When  we  test  for  the  significance  of  the  nesting  effect  we 
are  testing  the  hypothesis  that  Q(c()  =  0.   But 

Q(a)   =  0 


<=>  ct'   §  r    Q,   §  1    a  =  0 

~  "^  .   ~n .  -'  1^  .   ~n .  -'~ 

1=1   1.     1=1   1. 


i=l   i. 


-114- 


i=l 


'-^  J   )  --^  J   ](  »  1 
■n    n .  •'    n    n   -^  ^  .   ~n . 


1    a  =  0 
1=1   1. 


<=>  (  ®  1   )a  -  f-i-  y  n.  a.)l     =  0   .         (4.1) 
^.   ~n.  ^~    "^n    .^,  1.  i^~n     ~ 
1=1   1.       ••  1=1 


It  can  be  shown  that  (4.1)  implies  a,  =  a2  =  •••  =  a  .  Hence, 

when  we  test  the  significance  of  the  fixed  effects,  we  are  testing 

the  hypothesis  H  :   a,  =  ct^  =  •  •  •  =  a  . 
■'^  o     1     2  a 

Note  from  Table  4.1,  that  under  the  hypothesis  H  ,  we  cannot 

find  tv70  mean  squares  whose  expectation  values  are  the  same. 

Hence,  we  need  to  use  Satter thwaite ' s  approximation  to  derive  an 

approximate  test  for  this  hypothesis.   This  test  is  of  the  form 


^Qi^/fi 


>i/^2)f>':v-^i:-  ^)t 


f3  ^  M 


(4.2) 


From  Satterthwaite  (1946),  the  number  of  denominator  degrees  of 
freedom  is  estimated  by 


{r-MS(6|a)    -   (j^-    0    MSJ2 
[/MS(s|a)]2    +    [(^-    1)MS  J2 


(4.3) 
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The  F'  test  (4.2),  can  be  used  to  test  H   since  the  expectation 
value  of  the  nuraerator  and  denominator  are  equivalent  under  this 
hypothesis,  that  is, 


^H  irQi^^i  = 


=  I,  of-   +  o' 


'I    b 


2   2 


(i;  -  1)  17  rQ^v} 


where  E,,   denotes  the  expected  value  under  H  . 
rig  o 

Recall  that  in  CHAPTER  THREE  we  derived  an  exact  test  for 

testing  estimable  linear  functions  of  the  fixed  (nesting)  effects, 

that  is,  for  testing  the  hypothesis  H  :  R'a  =  ra,  where  R'  is  a 

o    ~   ~ 

full  row  rank  matrix.   The  test  statistic 


F(H)  = 


SSE^  V(m  -a) 


has  a  central  F  with  s  and  (m, -a)  nuraerator  and  denominator 
degrees  of  freedom,  respectively,  under  H  .   Under  H  ,  F(H)  has  a 
noncentral  F  with  noncentrality  parameter, 


(4.4) 


Since  F(H)  has  an  exact  distribution,  we  can  obtain  the  critical 
values  of  interest  directly  from  the  F  table.   On  the  other  hand, 
the  approximate  test,  F' ,  in  (4.2)  does  not  have  a  known 
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distribution  under  H   (or  under  H  ).   Therefore,  we  have  to  use  a 
Monte  Carlo  simulation  to  estimate  the  critical  values  for  the 
approximate  test  statistic  F' .   Furthermore,  in  order  to  obtain 
the  critical  values  for  F'  it  is  necessary  to  specify  a?  and  a^  , 
the  variance  components  associated  with  the  nested  effect  and 
error,  respectively.   It  should  also  be  noted  that  the  exact  test 
allows  the  testing  of  any  group  of  independent  estimable  linear 
functions  of  the  fixed  effects,  whereas  the  approximate  test  is 
designed  for  testing  only  the  hypothesis  H  :  a ,  =  :1t  =  •  •  •  a  . 

In  the  next  two  sections  we  shall  compare  the  power  of  the 
exact  test  with  that  of  the  approximate  test  F"  . 

4.1.2    Param.eters  and  Designs  Used  in  the  Power  Study 

As  previously  mentioned,  F' ,  does  not  have  a  known  exact 
distribution  under  either  the  null  or  the  alternative 
hypotheses.   Hence,  in  order  to  study  the  power  of  F'  we  need  to 
estimate  its  critical  values  using  a  Monte  Carlo  simulation. 
Under  H   and  with  y  =  0  and  a^  =  1  (both  without  loss  of 
generality),  it  follows  from  (3.21)  that 


and 


h  (I)  =  5 


Var(^)  =  X^X^^al   +  I 


(4.5) 
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Making  use  of  Che  RANNOR  function  in  SAS  (1985),  we  generated 

observations  which  are  independently  and  normally  distributed  with 

mean  zero  and  variance  equal  to  unity.   Let  y  denote  the  vector 
of  observations  generated  from  the  random  number  generator, 

RANNOR.   Now  consider  the  transformation,  z,. 


5l  =  ""'iiv 


(4.6) 


Then,  Var(z  J  =  V'j'V  ,  and  V.  is  the  Cholesky  decomposition  of  the 
variance-covariance  matrix  of  y.   The  random  variable  t.-,    has  the 
required  expected  vector  and  variance-covariance  matrix  to 
estimate  the  critical  values  of  F' .   That  is, 


and 


^(^i)  =  Er  ^-X)  =  2 


Var(z^)  =  Var(^)  =  ^^^X^a^   +   I 


(4.7) 


For  every  vector  z,  generated,  a  value  of  F'  is  calculated.   Ten 
samples  consisting  of  1000  F's  each  were  generated  for  each  design 
and  values  of  variance  components  considered.   For  each  sample  the 
90th,  95th  and  99th  percentiles  of  the  calculated  F's  were 
obtained.   The  mean  and  its  standard  error  for  the  ten  V 
quantiles  were  computed  to  estimate  the  critical  values  of 
interest. 
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Once  estimates  of  the  critical  values  of  F'  are  obtained  the 
associated  power  can  be  determined,  not  through  further 
simulation,  but  by  using  Imhof's  (1961)  procedure.   Essentially, 
any  quadratic  form,  Q  ,  of  independently  distributed  normal  random 
variables  with  mean  y .  and  variance  equal  to  unity  can  be 
expressed  as 


x'Ax  = 


(4.8) 


i=l 


where  a  .  (i=l  ,2  , . . .  ,£)  are  the  nonzero  eigenvalues  of  A;  z^.  's  are 
independently  distributed  non-central  x^  distributed  random 
variables  with  one  degree  of  freedom  and  noncentrality 
parameter  C?(z.~  N(5.,l)).   For  any  f,  P(Q   >  f)  is  then 
calculated  using  the  cumulative  distribution  function  of  Q  ,  which 
is  obtained  in  Imhof's  Procedure  by  inverting  the  characteristic 
function  of  Q  .   Let  f   denote  a  critical  value  obtained  from  the 
Monte  Carlo  simulation.   The  power  of  F'  can  be  expressed  as 


Ph  IF'  >  f  j, 


(4.9) 


where  the  probability  value  in  (4.9)  is  obtained  under  H  . 

Now  in  order  to  use  Imhof's  Procedure  we  need  to  express 
(4.9)  as  a  probability  value  associated  with  a  quadratic  form  of 
independently  distributed  normal  random  variables  with  mean  i;  ,•  and 
variance  equal  to  unity,  that  is,  as  in  (4.8).   Consider  again 
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(4.1), 


F'    = 


"2        2 


and    let    c,    =  £,/£2   arid    Cj    =    l~c,.      The    power    can   be    expressed    as 


■Qi     ^1^ 


^2^ 


a  a  1  2  3 


Now  under  H  ,  the  vector  of  observations  y  has 


and 


E^  (^)  =  X^a        (m  =  0) 
a 


(4.11) 


where  a   is  the  vector  of  fixed  effects  under  H  . 
~  a 

Let  E   =  Var(^).   The  matrix  E,  is  symmetric;  hence,  there  exists 
an  orthogonal  matrix  P  such  that 


P^^P'  =A,. 


(4.12) 


where  A,  is  a  diagonal  matrix  whose  diagonal  elements  are  the 
eigenvalues  of  E ,  .   It  follows  that  T.     2  c^m  ^g  expressed  as 


I    '2    =  p-A^2p. 


(4.13) 
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Consider  the  transformation 


,-^-^x 


(4.14) 


The    expected   value    and    variance-covariance    of    u  under   H      can   be 
written   as, 


and 


E(u)    =   Z^    '2x^a 


-1/  _  1/ 

Var(u)    =   Z      '2var(^)Z      '2 

-  Vo         -  Vo 
=   Z,      2x    z,    '2=1 
1  11  n 


(4.15) 


respectively.      As   a    result, 


a  a  12  3 


=    Pj^   {u'Au  >   0}  , 


(4.16) 


where 
and 


1/      Qi         c    f  c    f             1/ 

A  =  z'2  r-i I 0     -  — 0  1^^2 

^        h    ^f^        ^7^2  ^^3J^1 

u  ~   n(z'^/2x^cc*,    I^  ). 


By   using    the    transformation    in    (4.14)    v/e    can    use    Imhof's    Procedure 
in   Appendix   G    to    compute    the    power    of    the   approximate    test    F' . 
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The  noncentrality  parameter,  n  ,  in  (4.4)  for  the  exact  test 
F(H)  depends  on  a?,  the  variance  component  associated  with  the 
nested  effect;  hence,  the  power  of  F(H)  depends  on  this 
parameter.   Likewise,  the  power  of  the  approximate  test  F'  depends 
on  a?.   Note  that  from  (4.6),  the  critical  values  associated  with 
F'  depend  on  a?  since  the  observations  generated  from  the  Monte 
Carlo  simulation  required  specifying  values  for  this  parameter. 
Consequently,  in  the  study  that  follows  we  consider  a  range  of 
values  for  a?,  in  particular, 


al   =  .25,  .75,  1,  3,  6,  and  16  . 

D 


(4.17) 


The  power  depends  also  on  the  vector  of  fixed  effects 
specified  by  the  alternative  hypothesis  H  .   We  considered  four 
vectors  a,,  a  ,  a.,  and  a,  which  are  ordered  according  to  their 
Euclidean  norm  values, 


0.5 
0.75 
1 
1.25 


0.5 
1.5 
3.0 
4.5 


(4.18) 


1.0 
1.5 
3.0 
6.0 


The  superscript  signifies  that  we  are  under  H^ 


2 

.0 

5 

.0 

7 

0 

8 

.0 
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Now,  when  we  have  a  balanced  design, 

MS(a)     y'Q,yf, 


F,  = 


(4.19) 


b   MS(3|a)     X\:^'^{ 
(see  Table  4.1)  has  an  exact  F  distribution  under  H  and, 
therefore,  F,  provides  an  exact  test  for  H  .   In  general,  when  we 
have  an  unbalanced  design,  MS(a)  and  MS(^|ci)  are  not  constant 
multiples  of  chi-square  variates  and  are  not  independently 
distributed.   In  practice  this  is  ignored  and  Satterthwaite ' s 
approximation  is  used  to  derive  a  test  for  H  .   This  is  inadequate 
since  this  approximation  requires  that  MS(a)  and  MS(^|a)  have  chi- 
square  type  distributions  and  be  Independently  distributed.   As 
previously  mentioned  there  are  some  conditions  under  which  one  or 
both  of  these  requirements  are  satisfied. 

Under  last-stage  uniformity,  that  is,  when  n. .  =  n  V.., 
MS(g)  and  MS(^|ci)  are  chi-square  type  distributions  and  are 
independently  distributed.   Hence,  the  conditions  are  correct  for 
applying  the  Satterthwaite  approximation  however,  there  is  no  need 
to  use  this  approximation,  since  F,  in  (4.19)  provides  an  exact 


The  condition  of  partial  balance,  that  is,  when  n..  =  n..^ 

'       ij     ij    1 

and  j  *    j',  as  pointed  out  in  Tietjen  (1974),  is  a  sufficient 
condition  for  the  independence  of  MS(a)  and  MS(g|g).   Hence,  under 
partial  balance  we  at  least  satisfy  one  of  the  requirements 
necessary  for  applying  Satterthwaite 's  approximation. 
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Froni  above,  it  is  apparent  that  the  degree  of  imbalance 
affects  the  power  of  the  approximate  test  (we  know  it  affects  the 
exact  test  because  of  -^j^g^-*  *   ^^  considered  this  in  the  power 
study  by  looking  at  designs  with  varying  degrees  of  imbalance. 

Khuri  (1986)  proposed  measures  to  quantify  the  degree  of 
departure  of  the  design  from  last-stage  uniformity,  partial 
balance,  or  complete  balance.   These  are  for  last-stage 
uniformity. 


^  1_ 

^    1  +  c2 


(4.20) 


n  .  .  -  n 


\2 


where  c^    =   I     — ^^^ '-^   /n^  ^   (n^^  =  n^^/mj, 

ij      n_ 


and  for  partial  balance, 


1  +  ci 


(4.21) 


(n. .  -  n.  /m. ]2 

where  c^    =   I     — ^ 1^ /n 

2    . .      n .  /m. 
ij       1.   1 


The  measure  for  complete  balance  will  depend  on  the  variation  in 
both  the  m. 's  and  the  n..'s;  hence,  to  measure  departure  from 
complete  balance  we  use  the  quantity 
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1  +  (c2  +  c2; 


where  c^ 


y  (m.  -  m  )2 /m  1 /m 
i=l   1     •     •    • 


(4.22) 


(m,  =  m,/a,  c^  is  defined  in  (4.20) 
We  have 


0  <  <^^,  *2'  *3  ^  ^ 


(4.23) 


For  i=l,2,3,  as  (j> .  approaches  1,  the  degree  of  imbalance  becomes 
less  severe.   Hence,  in  the  power  study,  we  considered  designs 
which  reflect  different  degrees  of  imbalance  based  on  (j)  ,  ,  (})2,  and 
<^^.      The  designs  and  results  of  the  study  follow.   Note  that 
Designs  1  and  2  have  four  levels  for  the  fixed  effects.  Designs  3, 
4,  and  5  have  three  levels  and  Designs  6,  7,  and  8  have  two 
levels. 
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4.1.3    Results 

Table  4.2.   Power  values  of  the  Approximate  and  Exact  Test  for  the 

2-Fold  Nested  Mixed  Model 
((j)^  for  i=l,2,3  are  the  measures  of  departure  from  last  stage 
uniformity,  partial  balance,  and  complete  balance,  respectively.) 


DESIGN  1  (j)^  =  ((,2  =  ((,3  =  .60 

N  =  44      a  =  4       m,  =mr,=mT=m/ =2 

rijpl,  nj^2^10;   ^21^^'  "22^^^'   ^31^^»  no2=10;   n^-|=l,  n,^^^^ 
af  =  (0.5,  .75,  1.0,  1.25) 

a  =  .01  a   =  .05  ct  =  .10 

c^^/c^l        Approx.    Exact    Approx.    Exact    Approx.    Exact 


.25 

.328 

.013 

.364 

.064 

.467 

.124 

.75 

.164 

.012 

.244 

.060 

.251 

.117 

1.00 

.122 

.012 

.213 

.058 

.199 

.115 

3.00 

.050 

•  Oil 

.084 

.054 

.138 

.108 

6.00 

.024 

.010 

.072 

.052 

.128 

.104 

16.00 

.010 

.010 

.054 

.051 

.114 

.102 

DESIGN  1  (|)^=())2=<i)3=.60 


N  =  44        a  =  4     m,=m2=rao=m/= 


n^^  =  l,  n^2=^-0;   "21"^^'  "22^^^'   "^31^^'  "32^^^'   "41^^»  "42^^^ 


-^/^ 

a  = 
Approx. 

.01 
Exact 

a  = 
Approx. 

.05 
Exact 

a  = 
Approx. 

.10 
Exact 

.25 

.429 

.164 

.524 

.498 

.686 

.696 

.75 

.205 

.111 

.444 

.377 

.513 

.568 

1.00 

.071 

.096 

.276 

.336 

.316 

.520 

3.00 

.068 

.046 

.095 

.189 

.192 

.323 

6.00 

.028 

.029 

.090 

.127 

.129 

.229 

16.00 

.013 

.017 

.062 

.080 

.121 

.153 
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Table    4.2-continued 


DESIGN 

1 

*1 

-  (J)  2  -  4> 

3 

=  .60 

N  =  44 

a  =  4 

in,  =m.-,= 

inT=ni/ =2 

"11=^' 

n^2= 

=10;   n2^= 

1,  n22=10, 

"31=1' 

no2=10; 

"41 

=1,  n^2= 

IC 

33  =  (1 

.0, 

1.5,  3.0, 

6.0) 

^V^l 

a  = 
Approx. 

.01 
Exact 

a  = 
Approx. 

.05 
Exact 

ct  = 
Approx. 

• 

10 
Exact 

.25 

.461 

.295 

.566 

.710 

.795 

.874 

.75 

.126 

.200 

.446 

.566 

.624 

.760 

1.00 

.085 

.171 

.324 

.511 

.516 

.709 

3.00 

.072 

.077 

.097 

.286 

.202 

.456 

6.00 

.027 

.044 

.094 

.181 

.134 

.311 

16.00 

.015 

■.022 

.065 

.101 

.126 

.187 

DESIGN    1 
N   =   44 


=  (f-- 


a    =   4 


nil  =Tno=mT=m/  =2 


nj^,=l,    n,2=10;      "21  =  ''»    ^22=1-0; 
a|   =    (2.0,    5.0,    7.0,    8.0) 


3-"'4" 
^31 


=  1,    n32=10;      n^i  =  l,    '^/^2' 


=    .60 


opol 

a  = 
Approx. 

.01 
Exact 

a  = 
Approx. 

.05 
Exact 

a  = 
Approx. 

.10 
Exact 

.25 

.500 

.418 

.672 

.838 

.765 

.949 

.75 

.264 

.291 

.433 

.705 

.524 

.870 

1.00 

.121 

.250 

.211 

.647 

.328 

.828 

3.00 

.088 

.111 

.144 

.377 

.325 

.577 

6.00 

.043 

.060 

.117 

.234 

.124 

.388 

16.00 

.015 

.028 

.089 

.122 

.100 

.293 
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Table  4. 2-continued 


DESIGN  2 

N  =  44 


,70 


m,  =ni^=iii^=m,  =2 

11~"'  "12"""'   "21"-''  "22"-'"'   "31"-^'  "32"^ 
f   =  (0.5,  .75,  1.0,  1.25) 


1  '"2  '"3 
=1,  n,^=10;   n«,=l,  0^^=10; 


n, ,=3, 
41 


'42" 


b   e 

a  = 
Approx. 

.01 
Exact 

a  = 
Approx. 

.05 
Exact 

a  = 
Approx. 

.10 
Exact 

.25 

.210 

.013 

.310 

.064 

.333 

.124 

.75 

.086 

.012 

.118 

.060 

.174 

.117 

1.00 

.043 

.012 

.104 

.058 

.126 

.115 

3.00 

.024 

.011 

.083 

.054 

.119 

.108 

6.00 

.015 

.010 

.070 

.052 

.118 

.104 

16.00 

.011 

.010 

.051 

.051 

.091 

.102 

DESIGN  2 

N  =  44 


'11 


=  1,  n 


1 


a  =  4 


[i^=rn')=m/ =2 


12' 


ao; 


'21- 


■1,  n22=l-0; 


'31 


=3,  n32=8; 


<t'2  "^ 


=  .70 


=  (0.5,  1.5,  3.0,  4.5) 


a2/a2 
b   e 


Approx. 


,01 
Exact 


ci  =  .05 
Approx.    Exact 


Approx. 


,10 
Exact 


.25 

.492 

.164 

.664 

.498 

.732 

.696 

.75 

.173 

.111 

.298 

.376 

.312 

.568 

1.00 

.038 

.096 

.278 

.336 

.301 

.520 

3.00 

.021 

.046 

.097 

.189 

.134 

.323 

6.00 

.014 

.029 

.084 

.126 

.114 

.229 

16.00 

.014 

.017 

.049 

.080 

.090 

.153 
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Table  4.2-continued 


DESIGN    2 
N   =    44 


.70 


a   =   4 


m,  =tDr,=mT=iii ,  =2 


—  iUr\  — 111  o  — 1^1  / 

2      J      4 
nj,=l,    n,^  =  10;      n2i=l,    nrsy=lO;      nT,=3,    nT2=8;      n,  , 

af  =    (1.0,    1.5,    3.0,    6.0) 


=  3, 


'42" 


^1^4 

a  = 
Approx. 

.01 
Exact 

cc  = 
Approx. 

.05 
Exact 

a.   = 
Approx. 

.10 
Exact 

.25 

.444 

.295 

.761 

.710 

.801 

.874 

.75 

.195 

.200 

.375 

.566 

.389 

.760 

1.00 

.051 

.171 

.332 

.511 

.378 

.709 

3.00 

.027 

.077 

.074 

.286 

.123 

.456 

6.00 

.012 

.044 

.062 

.181 

.100 

.311 

16.00 

.009 

.022 

.049 

.101 

.086 

.187 

DESIGN    2 

N     —     4*4  a     —     4  uii  — iU(^— uiQ  — in  /  - 

n^^  =  l,    n,2=10;      "^21"^'    '^22~^^'      '^ti"-^'    "to"^ 
a^  =    (2.0,    5.0,    7.0,    8.0) 


m, =mo=mo=m/ 


'31" 


=    .70 


'41 


=3,    n^2= 


^1/4 

a  = 
Approx. 

.01 
Exact 

a  = 
Approx. 

.05 
Exact 

a  = 
Approx. 

.10 
Exact 

.25 

.500 

.418 

.514 

.838 

.543 

.949 

.75 

.103 

.291 

.218 

.705 

.372 

.870 

1.00 

.074 

.250 

.156 

.647 

.222 

.828 

3.00 

.0  52 

.111 

.061 

.377 

.168 

.568 

6.00 

.023 

.060 

.045 

.234 

.106 

.388 

16.00 

.010 

.028 

.032 

.122 

.099 

.201 
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Table    4.  2-continuecl 


DESIGN    3  i 

N   =    44  a   =    3  m,=    2;    012=    3;    no= 

"ll"^'    "l2~^^'      "21"^'    '^22~^»    '^23~''^' 
a^  =    (0.5,    .75,    1.00) 


^   =    .63     ^,2   "    '59     <}>3 
4 


.57 


'31 


=  1 


32" 


=5,    noo=7,    n^,=l 


'33 


34' 


^IH 

a  = 
Approx. 

.01 
Exact 

a  = 
Approx. 

.05 
Exact 

a  = 
\pprox. 

.10 
Exact 

.25 

.073 

.013 

.140 

.063 

.156 

.123 

.75 

.041 

.012 

.126 

.060 

.145 

.116 

1.00 

.033 

.012 

.057 

.058 

.142 

.114 

3.00 

.022 

.011 

.048 

.054 

.106 

.107 

5.00 

.016 

.010 

.046 

.052 

.103 

.104 

16.00 

.016 

.010 

.046 

.051 

.102 

.103 

DESIGN   3  4,^    =    .63     <i:  ^  =    .59     <t> . 

N   =   44  a   =   3  m^=    2;    m2=3;    mo=    4 

'^ll"'^'    "l2~^^'      '^21~''''    "^22"^'    '^23"^^'      "31~^»    ^^2'''*    "33"^' 
af   =    (0.5,    1.5,    3.0) 


.57 


ol/al 

a  = 
Approx. 

.01 
Exact 

a  = 
Approx. 

.05 
Exact 

a  = 
Approx. 

.10 
Exact 

.25 

.076 

.168 

.167 

.454 

.241 

.626 

.75 

.047 

.112 

.124 

.341 

.179 

.502 

1.00 

.023 

.095 

.035 

.303 

.176 

.458 

3.00 

.019 

.047 

.025 

.172 

.067 

.287 

6.00 

.015 

.028 

.019 

.117 

.054 

.207 

16.00 

.010 

.017 

.013 

.077 

.032 

.144 

-no- 


Table  4. 2-continued 


DESIGN  3  ( 

N  =  44     a  =  3      m,=  2;  102=  3;  mo= 
n,.=4,  n,rj=ll;   nr,,  =  l,  n^2~2,  n,^T=12; 

af  =  (2.0,  5.0,  7.0) 


J  =  .63  (}>2  =  .59  <i 
4 

'^31~   ^22~        ^33"  ' 


.57 


'34- 


0      e 

a  = 
Approx. 

.01 
Exact 

a  = 
Approx. 

.05 
Exact 

a  = 
■\pprox. 

.10 
Exact 

.25 

.496 

.693 

.524 

.947 

.610 

.986 

.75 

.132 

.514 

.283 

.855 

.312 

.943 

1.00 

.089 

.448 

.103 

.805 

.161 

.914 

3.00 

.058 

.197 

.063 

.505 

.124 

.676 

6.00 

.019 

.100 

.046 

.314 

.110 

.407 

16.00 

.008 

.040 

.036 

.153 

.106 

.236 
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Table  4.2-contlnued 


DESIGN  4 

N  =  44     a  =  3 

=4 


=  .76  (J),  =  .74 


=  .70 


m,=  2;  mr,=  3;  mT=  4 


=  1, 


11  "'  "12  "'   "21" 
J  =  (0.5,  .75,  1.00) 


'22 


=  5,  n 


23' 


ao; 


^31- 


'32 


=4,  033=4 


"34=^ 


4/01 

a  = 
Approx. 

.01 
Exact 

a  = 
Approx. 

.05 
Exact 

a  = 
Approx. 

.10 
Exact 

.25 

.033 

.013 

.088 

.063 

.243 

.123 

.75 

.012 

.012 

.064 

.060 

.093 

.116 

1.00 

.011 

.012 

.045 

.058 

.116 

.114 

3.00 

.009 

.011 

.038 

.054 

.096 

.107 

6.00 

.007 

.011 

.038 

.052 

.092 

.104 

16.00 

.007 

.010 

.037 

.051 

.091 

.102 

DESIGN   4  ({i^    =    .76     <i>  2   =    .74     (f>  3   =    .70 

N   =   44  a   =   3  m,=    2;    1112=    3;    1113=    4 

"11"^'    n^2=8;      ^21"^^'  ^^22"^'    ^^23"^^'      "3l"^'    "32"^'    "33^'^'    "34"^ 
a^   =    (1.0,    1.5,    3.0) 


ol/ol 

a  = 
Approx. 

.01 
Exact 

a  = 
Approx. 

.05 
Exact 

a  = 
Approx. 

.10 
Exact 

.25 

.052 

.168 

.073 

.454 

.431 

.626 

.75 

.021 

.112 

.076 

.341 

.184 

.502 

1.00 

.011 

.095 

.043 

.303 

.078 

.458 

3.00 

.010 

.045 

.024 

.172 

.052 

.287 

6.00 

.009 

.028 

.018 

.117 

.032 

.207 

16.00 

.008 

.017 

.016 

.077 

.027 

.144 

Table  4.2-continued 
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DESIGN  4 
N  =  44 
=  4.  n 


'II 


12 


=8; 


'21 


=  1 


Ct/, 


=  (2.0,  5.0,  7.0) 


=  .76  ()),  =  .74 


"22^ 


2;  m^=  3;  m^=  4 


=5,  n23=10 


'31- 


'32 


=4, 


'33" 


=  .70 


'34- 


ollal 

a  = 
Approx. 

.01 

Exact 

a  = 
Approx. 

.05 
Exact 

a  = 
Approx. 

.10 
Exact 

.25 

.498 

.693 

.532 

.947 

.555 

.986 

.75 

.125 

.514 

.274 

.855 

.297 

.943 

1.00 

.087 

.448 

.111 

.805 

.244 

.914 

3.00 

.045 

.197 

.074 

.505 

.123 

.676 

6.00 

.035 

.099 

.053 

.314 

.112 

.471 

16.00 

.035 

.040 

.039 

.153 

.064 

.236 

-133- 


Table  4.2-continued 


DESIGN  5 

N  =  44     a  =  3 

af  =    (0.5,  .75,  1.0) 


mi=  019=  3;  nio- 
i2i=3, 022=5,023= 


^  =  .94  (j)2  =  -91  (J)3  =  .90 


,3^=4,032=4,033=4,03^=4 


</4 


a   =  .01 
Approx.    Exact 


a  =  .05 
Approx.    Exact 


a 
Approx, 


,10 
Exact 


.25 

.025 

.020 

.096 

.089 

.183 

.163 

.75 

.016 

.015 

.058 

.070 

.077 

.134 

1.00 

.014 

.014 

.044 

.066 

.074 

.127 

3.00 

.007 

.012 

.032 

.056 

.061 

.111 

6.00 

.006 

.011 

.018 

.053 

.040 

.105 

16.00 

.006 

.010 

.012 

.051 

.033 

.102 

'I 


3;  mT=  4 


DESIGN  5 

N  =  44     a  =  3 

Oi,=5,Oio=4,Oi-i  =  3;   02i=3,022=5, 023=8; 

a|  =  (1.0,  1.5,  3.0) 


=  .94  ((),=  . 91  ())^=.90 


'3r 


=4,n^,=4,o^o=4,no,=4 


132 


33' 


^^4 

a  = 
Approx. 

.01 
Exact 

a  = 
Approx. 

.05 
Exact 

a  = 
Approx. 

.10 
Exact 

.25 

.031 

.576 

.042 

.881 

.112 

.953 

.75 

.015 

.290 

.029 

.624 

.110 

.777 

1.00 

.012 

.224 

.027 

.533 

.056 

.696 

3.00 

.006 

.073 

.027 

.243 

.033 

.379 

6.00 

.005 

.038 

.023 

.147 

.032 

.250 

16.00 

.005 

.020 

.014 

.086 

.011 

.158 
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Table  4.2-coatinued 


DESIGN 

N  =  44 

4  =  (2 


a  =  3 
,=4,n,o=3: 


12~^'"13~"'   "21 
.0,  5.0,  7.0) 


,=  m2=  3;  mo=  4 
=3.nTo=5,n. 


',"22" 


'23' 


=  .94  4)^=. 91  4)3  = 
13^=4, 032=^, n33=4,n3^=4 


.90 


^l/< 


ct  =  .01 
Approx.    Exact 


a  =  .05 
Approx.    Exact 


a  =  .10 
\pprox.    Exact 


.25 

.497 

.997 

.550 

.999 

.643 

1.00 

.75 

.224 

.919 

.312 

.995 

.555 

.999 

1.00 

.113 

.845 

.221 

.984 

.288 

.997 

3.00 

.095 

.380 

.106 

.727 

.176 

.857 

6.00 

.034 

.172 

.087 

.450 

.100 

.615 

16.00 

.006 

.057 

.022 

.200 

.065 

.312 
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Table  4.2-continued 


DESIGN 

6 

*1  = 

.49  <t,2  =  *3 

=  .43 

N  =  44 

a  =  2 

mi=  m^=   2 

"11=^' 

a^2= 

=10;   021= 

1,  022=32 

af  =  (0 

•5, 

.75) 

ol/ol 

a  = 
Approx. 

.01 
Exact 

a  = 
Approx. 

.05 
ExacC 

a  = 
Approx. 

10 
Exact 

.25 

.465 

.010 

.538 

.052 

.559 

.104 

.75 

.306 

.010 

.344 

.052 

.406 

.103 

1.00 

.281 

.010 

.315 

.051 

.357 

.103 

3.00 

.134 

.010 

.185 

.051 

.236 

.101 

6.00 

.084 

.010 

.128 

.050 

.166 

.101 

16.00 

.045 

.010 

.077 

.050 

.135 

.100 

DESIGN  6 

N  =  44     a  =  2 

ni,=l,  n,2=10;   r 


21 


=  1, 


'22 


'2-  ' 
=  32 


=  .49  4). 


=  .43 


a2/a2 
b   e 


a   =  .01 
Approx.    Exact 


a  =  .05 
Approx.    Exact 


Approx. 


.10 
Exact 


.25 

.478 

.012 

.579 

.059 

.559 

.117 

.75 

.300 

.011 

.361 

.057 

.419 

.112 

1.00 

.290 

.011 

.322 

.056 

.379 

.110 

3.00 

.131 

•  Oil 

.187 

.053 

.234 

.105 

6.00 

.086 

.010 

.131 

.052 

.169 

.103 

16.00 

.045 

.010 

.077 

.051 

.136 

.101 
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Table    4. 2-continued 


DESIGN 

6 

*1  = 

.49  <^2  =  *3 

=  .43 

N  =  44 

a  =  2 

m,=  m«=  2 

"ir^' 

"12= 

=  10;   n2]^  = 

1,  1122=32 

af  =  (0 

.5, 

1.5) 

b   e 

a  = 
Approx. 

.01 
Exact 

a  = 
Approx. 

.05 
Exact 

a  = 
Approx. 

10 
Exact 

.25 

.505 

.018 

.581 

.086 

.623 

.166 

.75 

.324 

.016 

.359 

.076 

.410 

.148 

1.00 

.290 

.015 

.317 

.073 

.366 

.142 

3.00 

.134 

.012 

.197 

.061 

.232 

.121 

6.00 

.085 

.011 

.129 

.057 

.167 

.112 

16.00 

.045 

.010 

.077 

.053 

.135 

.105 

DESIGN    6 

N  =   44  a   =    2 

n^pl,    n^2=10;      "21 
af   =    (2.0,    5.0) 


III,  =   m^=    2 


=  1, 


'22 


=  32 


^^   =    .49     4-2   = 


.43 


a  = 

.01 

a  = 

.05 

a  = 

.10 

al/ol 

Approx. 

Exact 

Approx. 

Exact 

Approx. 

Exact 

.25 

.633 

.078 

.700 

.331 

.823 

.546 

.75 

.370 

.060 

.474 

.261 

.510 

.448 

1.00 

.361 

.053 

.419 

.237 

.500 

.413 

3.00 

.117 

.032 

.215 

.149 

.356 

.273 

6.00 

.103 

.022 

.156 

.108 

.194 

.203 

16.00 

.049 

.015 

.083 

.074 

.111 

.096 
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Table  4. 2-continued 


DESIGN    7 

N   =    44  a   =    2 


=    .76     (j),    =    .71 


=    .50 


ra,=   2;    m^= 


"11=^'  ' 

^12  = 

-7;      n2p 

13 

,    n^2~l^> 

rioo    —6 

a^i  =  (0 

5, 

.75) 

^V4 

a 
Approx 

— 

.01 
Exact 

a   = 
A.pprox. 

.05 
Exact 

a    = 
Approx. 

.10 
Exact 

.25 

.016 

.011 

.057 

.054 

.104 

.106 

.75 

.015 

.011 

.049 

.053 

.098 

.104 

1.00 

.011 

.010 

.048 

.052 

.096 

.104 

3.00 

.010 

.010 

.044 

.051 

.096 

.102 

6.00 

.010 

.010 

.042 

.051 

.090 

.101 

16.00 

.009 

.010 

.041 

.050 

.084 

.100 

DESIGN    7 

N   =   44  a   =   2  m,=    2;    1119=    3 


ij    =    .76     <))2   =    .71     4>^   =    .50 


'11 


=  1, 


'12 


=  7: 


'21 


'1 
=13,    n„„=l7,    n 


'23 


=  6 


if   =    (1.0,    1.5) 


</< 


a  =    .01 
Approx.    Exact 


a  =  .05 
Approx.    Exact 


Approx. 


10 
Exact 


.25 

.014 

.014 

.038 

.065 

.113 

.125 

.75 

.013 

012 

.029 

.061 

.108 

.118 

1.00 

.010 

012 

.025 

.059 

.105 

.116 

3.00 

.008 

Oil 

.017 

.055 

.103 

.108 

6.00 

.008 

.011 

.016 

.053 

.107 

.104 

16.00 

.006 

010 

.016 

.051 

.108 

.102 
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Table  4. 2-coatinued 


DESIGN 

7 

h 

=  .76 

<J)  2  -  .71  (J)  3 

=  .50 

N  =  44 

a 

=2     m,=  2;  m2= 

3 

nn=i. 

^12 

=  7 

;   1121  =  13 

,  022=17, 

^23  =^ 

3:%   =    (0 

.5, 

1 

.5) 

a  = 

.01 

a  = 

.05 

a.   = 

10 

'V'^l 

Approx. 

Exact 

Approx. 

Exact 

Approx. 

Exact 

.25 

.019 

.024 

.053 

.109 

.137 

.199 

.75 

.017 

.020 

.049 

.092 

.098 

.171 

1.00 

.011 

.019 

.053 

.087 

.110 

.163 

3.00 

.010 

.014 

.047 

.068 

.109 

.132 

6.00 

.010 

.012 

.051 

.061 

.108 

.118 

16.00 

.009 

.011 

.050 

.054 

.109 

.107 

DESIGN    7 
N   =    44 


=    .76     4)9   =    .71 


=   2 


m,=    2;    1112=    ~' 
n,,  =  l,    i''i2~7;      n2]  =  13,    n22=17,    1123   =6 

4  =    (2.0,    5.0) 


=    .50 


a  = 

.01 

a  = 

.05 

Cl  = 

.10 

^V-l 

Approx. 

Exact 

Approx. 

Exact 

Approx. 

Exact 

.25 

.091 

.164 

.112 

.519 

.245 

.721 

.75 

.087 

.116 

.063 

.405 

.145 

.601 

1.00 

.034 

.102 

.056 

.365 

.125 

.556 

3.00 

.015 

.053 

.068 

.214 

.083 

.359 

6.00 

.014 

.033 

.067 

.145 

.079 

.255 

16.00 

.014 

.019 

.061 

.089 

.069 

.137 

-139- 


Table  4.2-continued 


DESIGN 
N  =  44 
n^pl4, 

4  =  (0 


.98  4.;,  =  ^  ^  =  .85 


a  =  2     in,=  m2=  2 
0,^=17;   n^ 1 =8 ,  nQ2=5 

^5,  .75) 


a2/a2 
b   e 


a  =  .01 
Approx.    Exact 


a  =  .05 
Approx.    Exact 


Approx. 


,10 
Exact 


.25 

016 

.011 

.101 

.056 

.128 

.112 

.75 

Oil 

.011 

.094 

.053 

.124 

.106 

1.00 

012 

.010 

.086 

.052 

.117 

.104 

3.00 

013 

.010 

.076 

.051 

.101 

.102 

6.00 

013 

.010 

.076 

.050 

.091 

.101 

16.00 

015 

.010 

.074 

.050 

.083 

.100 

DESIGN  8 

N  =  44     a  =  2     m,=  m2=  '. 

n,,=14,  n, 2=1-7;   n2i=8,  n22  =  5 

a^  =  (1.0,  1.5) 


.85 


<'^l 

a  = 
Approx. 

.01 
Exact 

C(  = 
Approx. 

.05 
Exact 

a  = 
Approx. 

.10 
Exact 

.25 

.034 

.015 

.104 

.075 

.131 

.146 

.75 

.014 

.013 

.068 

.062 

.130 

.122 

1.00 

.013 

.012 

.065 

.060 

.103 

.118 

3.00 

.013 

.011 

.067 

.054 

.087 

.107 

6.00 

.008 

.010 

.066 

.052 

.085 

.103 

16.00 

.006 

.010 

.064 

.051 

.076 

.101 
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Table    4.2-continued 


DESIGN   8 

M   =    44  a   =    2 


=    .85 


'11 


=  14,    n,9=17;      nr,,=8,    n-j-j  =  5 


a|  =  (0.5, 

1.5) 

a  = 

.01 

a  = 

.05 

a  = 

.10 

b   e 

Approx. 

Exacc 

Approx. 

Exact: 

Approx. 

Exact 

.25 

.088 

.032 

.124 

.148 

.165 

.271 

.75 

.050 

.020 

.069 

.098 

.128 

.186 

1.00 

.041 

.018 

.058 

.088 

.110 

.168 

3.00 

.032 

.013 

.055 

.064 

.107 

.126 

6.00 

.017 

.012 

.042 

.057 

.101 

.114 

16.00 

.014 

.011 

.033 

.053 

.100 

.105 

DESIGN    8 

N   =    44  a   =   2 

n,.=14,    n,2=17;      n2i=8,    n^^=5 

0,1   =    (2.0,    5.0) 


m,  =   m^^    2 


'22" 


=    .9^ 


.85 


a  = 

.01 

a  = 

.05 

a  = 

.10 

<l^l 

Approx. 

Exact 

Approx. 

Exact 

Approx. 

Exact 

.25 

.114 

.189 

.123 

.642 

.214 

.865 

.75 

.061 

.099 

.111 

.402 

.189 

.634 

1.00 

.036 

.081 

.106 

.341 

.131 

.558 

3.00 

.013 

.037 

.053 

.172 

.060 

.311 

6.00 

.011 

.024 

.050 

.115 

.052 

.216 

16.00 

.008 

.015 

.043 

.075 

.045 

.155 
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4.1.4    Analysis  of  Power  Study 

Consider  Designs  1  and  2  having  four  levels  for  the  nesting 

effect.   These  designs  differ  in  their  degree  of  irabalaTice  with 

Design  1  slightly  more  imbalanced  than  Design  2.   In  both  designs 

we  notice  that  the  power  is  greater  for  the  approximate  test  than 

the  exact  test  when  we  consider  the  vector,  a^,  of  fixed  effects 

under  H  .   For  ^% ,    the  approximate  test  continues  to  beat  the 

exact  test,  but,  only  for  the  smaller  values  of  A,  =  o^jo^    and,  in 

b    b   e 

general,  at  the  99th  percentile.   Note  that  when  A   >  1.0  the 

exact  test  soundly  defeats  the  approximate  test.   This  continues 

to  be  more  pronounced  as  we  look  at  the  tables  for  a„  and  a,. 

~3     ~4 

When  we  consider  these  vectors  of  fixed  effects,  the  exact  test, 
in  general,  has  a  better  performance. 

Hence,  it  appears  at  this  stage  that  small  departures  from 
the  null  hypothesis  and  small  values  of  A,  tends  to  favor  the 
approximate  test.   As  we  move  away  from  the  null,  the  power  of  the 
exact  test  dominates  the  power  of  the  approximate  test. 

Consider  Designs  3,  4,  and  5,  having  a  low,  medium,  and  high 
degree  of  imbalance,  respectively.   Design  3  continues  the  same 
pattern  observed  above  for  Designs  1  and  2,  that  is,  the 
approximate  test  exhibiting  greater  power  than  the  exact  test  for 
small  departures  from  the  null  (actually  only  for  a  ).   As  we 
consider  a^  and  a_  for  this  design  we  note  the  increasingly 
greater  power  of  the  exact  test  as  we  move  away  from  the  null, 
with  the  gap  between  the  powers  as  we  increase  A.  . 
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When  we  consider  Design  4,  having  moderate  imbalance,  we  have 
the  same  results  except  that  the  powers  of  the  approximate  test 
are  in  general  smaller  than  the  powers  of  the  approximate  test  in 
Design  3.   We  find  that  the  exact  test  on  almost  every  occasion 
has  greater  power  than  the  approximate  test.   Analogous  to  Design 
4,  in  Design  5  the  power  of  the  exact  test,  in  general,  is  larger 
than  the  power  of  the  approximate  test. 

Finally,  consider  Designs  6,  7,  and  8  having  two  levels  for 
the  fixed  effects.   Unlike  the  other  designs  discussed  thus  far, 
Design  6  has  the  approximate  test  with  a  power  that  almost 
completely  dominates  the  power  of  the  exact  test.   The  moderately 
imbalanced  Design  7,  exhibits  a  lower  power  for  the  approximate 
test  when  compared  to  Design  6,  and  in  general  for  this  design  the 
exact  and  approximate  powers  are  close.   Only,  for  a,  and  the  95th 
and  99th  percentiles  is  the  power  of  the  exact  test  clearly 
greater  than  the  power  of  the  approximate  test.   The  results  of 
Design  8  are  very  similar  to  the  results  of  Design  7.   Only  with 
approximate  and  exact  test  having  slightly  greater  power  compared 
to  the  powers  in  Design  7. 

Hence,  we  find  that  in  general,  the  exact  test  has  greater 
power  than  the  approximate  test  as  we  move  away  from  the  null 
(except  for  Design  6).   The  power  of  the  approximate  test  is 
particularly  strong  for  designs  having  a  greater  degree  of 
imbalance.   The  powers  for  both  the  approximate  and  exact  test  are 
a  decreasing  function  of  A,  .   On  several  occasions  this  appears 
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noC  to  be  the  case  for  the  approximate  test,  however,  this  is 
attributed  to  the  variation  that  exists  with  the  critical  value 
estimates  obtained  through  the  Monte  Carlo  simulation. 
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4.2   Power  Study  for  the  Two-Way  Gross  Classification  Mixed  Model. 
4.2.1   Introduction 

Consider  the  two-way  cross  classification  mixed  model  in 
(3.60).   In  the  last  chapter  exact  tests  were  developed  for 
testing  the  significance  of  both,  the  variance  component 
associated  with  the  random  main  effect,  and  the  fixed  effects  of 
the  model.   In  this  section  we  will  consider  a  power  comparison  of 
the  existing  approximate  procedures  and  the  new  derived  tests. 

Consider  the  analysis  of  variance  tables  of  the  unbalanced 
two-way  cross  classification  with  no  missing  cells  (see  Searle 
(1971,  pp.  292-301)). 


Table  4.3   Type  I  .\nalysis  of  Variance  Table  for  the  Two-Way 
Cross  Classification  Mixed  Model 


Source 


Degrees 
of  Freedom 


Mean 
Squares 


Expected 
Mean  Squares 


Main  Effect  (a) 

Main  Effect  (&) 

Interaction  (a3) 

Error 


r-1 

s-1 

(r-l)(s-l) 

n..-rs 


2-^^2 


MS(a|M)    Q^ia)+h^a^^+hfj+a 

MS(jj|y,j3)        ^3'^ld'^^^'^l-^^l 
MS(a^e|M,a,^)      ^S^Iq^I 


MS, 


ol 
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where 


r    y^      /n.      -    y^      /n 
MS(a|u)    =     ^  -^^     ^• 
i=l 


(r-1) 


-1 


MS(3    P,a) 


J    n.    y2        +    r'G,    r    -     2!    3^       /n.     , 

'",1.1..  •^         1~  .,!..         1. 

i=l i^J 

(s-1) 


(4.24) 


-1 


I    y2  .    /n  .  .    -  J    n  .    y2.        -   r'  G ,    r 
..ij.      ij         .       1.1..        ~       1~ 

MS(a3|w,a,S)    =  ^^ 


(r-l)(s-l) 


and 


MS      =    [    I    y^  .,     -   I      n..y2.    ]/(n      -rs) 
e       '-.':,    11k       ^.      1111.-' 


^        1  1 

Q,(a)    =   [E(y)]i    »     ^J  -^J        }  [  E(y)] /(  r-1 ) 


i=l      i.         i. 


r  r 

a'[    »   r      ]{    »     ^—  J  —  J 


»    1  a 

.     ,    ...          .     ,    n.         n.            n  n      '  "•  .      ~n.    ■'~ 

1=1       1.       1=1       1.         1. "  '  •       1=1       1 . 

(r-1) 
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S    = 


[c.l    =    n    .    =   y      n^./n.  whenever        1=1   <    s-1 

IV  .J  ..       ij       1. 

LJ 


[c..]    =  -     J^    n..n'./n.  whenever        iv^j    <    s-1 


ij 


i=l 


ij    ij       1 


(4.25) 


Xl   =        iv^,r^,...,v^_^y,    where    r.    =   {y^.^-  I    n..y.^J 


for  j    =    1,2, ... ,s-l 


Table    4.4      Type    II   Analysis    of    Variance    Table    for    the 
Two-Way  Cross    Classification  Mixed  Model 


Source 


Degrees 
of  Freedom 


Mean 
Squares 


Expected 
Mean  Squares 


Main  Effect  (01) 

Main  Effect  (^) 

Interaction  (a3) 
Error 


r-1 

s-1 

(r-l)(s-l) 


MS(a|u,^) 
MS(g|y ,a) 
MS(a6|y,a,^) 
MS. 


Q2(a)+h^a2g+a| 


-147- 


where 


MS(a|u,3)  =  {I  n.y.^^  +  Xi^i^Ei-  I  ".  j  i^.  j  j  /  ^"^"^  >  5 


(4.26) 


[E(^)]'{x^2^X'^2^12r^'l2  -  .*  ^^n.  ^^^^^^^ 


^2^3^ 


i=l   i.    i. 


(r-1) 


a'[  ®  r   ]{X,„[X'  X.J  X'   -   ®  -^J   }[  »  1    ]cc 

~   .   ~n.  ■' ^  12^  12  12^   12    .  ,n.   n.  •' ^  .   ~n.  -'~ 

1=1   1. 1  =  1  1.   1.   1  =  1   i« 

(r-1) 


where  X,„  =  [l 
12    '■~n 


*   1     :  X 
1=1    1. 


(x  =  [  §  r   :  *  r   :  ...  §  r  ■ 

j  =  l  "ij   j  =  l  "2j       j  =  l  \j 


Let  A„  =  [  ®  r   ]{X,-(X'  X,J  X'   -  »  -!-  J   }[  ®  1   ]  . 
X    '-.~n.  ■'^12^  12  12^   12    .,n.    n.-''-.~n.-' 
1=1   1.  1=1  1.    1.   1=1   1. 


Consider 


Q_(a)  =  0  <=>  a' A  a  =  0. 

Z  ~  ~   A~ 


The  matrix  A„  is  positive  semidef inite ,  consequently, 
A„  =  A ^  A  ■^  ;  hence, 

^^       A     A 


a  A  a  =  0  <=>  K^o.   =   0,   that  is, 
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a   is  in  the  orthogonal  complement  of  the  column  space  of  A^.   This 

space  has  dimension  equal  to  r-1.   Since  AyJ,   =  ^,    we  must 

have  alU  ,  therefore,  the  vector  j^  can  be  expressed  as  a  scalar 

multiple  of  the  vector  I    ,    that  is ,  a,  =  02  =  • • •  a^  when 

Q(a)  =  0.   Hence,  when  we  test  the  significance  of  the  fixed 

effects  using  the  type  II  sums  of  squares  (Table  4,4),  we  are 

testing  the  hypothesis  H    :  a,  =  a„  =  • • •  =  a  . 
o     1     2  r 

In  a  fashion  similar  to  the  derivations  in  (4.1),  one  can 

show  that  testing  the  fixed  effects  using  the  type  I  suras  of 

squares  (Table  4.3)  is  equivalent  to  testing  the  above 

hypothesis  H    :  a,  =  a.  =  •  •  •  =  a  . 
o     1     2  r 

Using  Tables  4.3  and  4.4  we  can  apply  Satterthwaite ' s 
approximation  and  derive  two  approximate  tests  for  the  hypothesis 
h(^).   Consider 


,(1) 


MS(a  y) 


(4.27) 


where 


^2      ,       lhi-1^2^/NJ       , 

p,  =  —  MS(8  u,a)  + r-^ MS(a6y,a,6) 

Ih,     ~i~         h^  i~~ 


+  (1  -  [h2/h^  + 


(h,  -  h  h./h,) 
1     2  3   4 


MS 


From  Table  4.3, 


4 
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(h,  -  h_h  /hj 
+  -i J  ^   "   {h,a2^  +  a2] 


h    h  -  h  h  /h 

+  [1  -  T—  +  r Ja2 

4        5 


=  E  ,,  JmS  (a|y)J  . 


Hence,  F    is  an  approximate  test  based  on  the  type  I  suras  of 
squares  for  testing  the  H^  -^i  a,  =  ct2  =  •••  =  a  . 
In  addition, 


•2)   ^S^sh.l 


(4.28) 


where 


h.  h 

P2  =  —  MS(a3|y,a,3)  +(l  -^)mS^, 


From  Table  4.4, 


E(P,)  =^{V^.«  .a2}  .(1  --i) 


h   ^  9  a6 


E    [MS(a|y,6)]. 


(2) 
Hence,  F    ,  based  on  the  type  II  sums  of  squares,  is  also  an 
a 

approximate  test  for  testing  the  fixed  effects. 


Finally,  consider 
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MS(6  u,c() 


'^--T- 


(4.29) 


where 


P3  =  —  MS(a^B|u,a,S)  +  [l  "  — )mS^ 


This  test  statistic  can  he  used  to  test  the  hypothesis 


h1^^:  al   =    0.   Note  that 
o     3 


E(P3)  =h^a2^  ^ol   =   E     (MS(6|y,a)). 
H 


These  tests  are  approximate  since  the  mean  squares  involved  in 
forming  the  test  statistics,  in  general,  do  not  have  chi-square 
type  distributions  and  are  not  independently  distributed. 
Furthermore,  the  denominator  degrees  of  freedom  of  these  F's  are 
approximate.   In  the  power  study  that  follows  we  will  compare  the 
powers  of  F^^^  and  F^^^  with  F*(U)  (see  (3.106))  and  Fg  with  Fj.  ^ 
(see  (3.84)],  for  testing  the  fixed  effects  and  variance  component 
associated  with  the  random  effects,  respectively. 
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4.2.2   Parameters  and  Designs  Used  in  the  Power  Study 

Again,  as  with  the  approximate  test  derived  for  testing  the 
fixed  effects  in  an  unbalanced  two-fold  nested  mixed  model,  the 
approximate  tests  derived  in  the  last  section  requires  a  Monte 
Carlo  simulation  to  obtain  the  critical  values  of  interest.   The 
critical  values  are  again  obtained  by  producing  ten  samples  of 
1000  randomly  generated  observations  of  each  of  the  three  test 
statistics  in  (4.27),  (4.28),  and  (4.29).   The  corresponding  90th, 
and  95th  percentiles  were  then  computed  for  each  of  the  samples. 
The  mean  and  the  standard  error  of  the  quantiles  obtained  from  the 
ten  samples  provide  an  estimate  of  the  critical  value. 

Note  that  from  (3.71),  for  a  two-way  cross  classification 
model, 

Var(y)  =  X  X'al    +   X^X^qS   +  I   a^    . 

Hence,  when  obtaining  the  critical  values  and  powers  for  F^    and 

( 2 ") 
Fa  ',  the  two  approximate  tests  for  testing  the  fixed  effects,  we 

had  to  specify  values  for  a|  and  i^^g .   The  critical  values  for  the 

approximate  test,  Fg  ,  for  testing  the  hypothesis  H^   :  ^\    -   0. 

9  (2) 

requires  specifying  values  only  for  cr^g .   Note  that  under  H^  ^' 

the  variance-covariance  of  y  depends  only  on  a^o  and  a^  (without 

loss  of  generality  we  set  a^  =  1).   We  considered  the  following 

values  for  a?  and  a^^ : 
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a2   =  0.5  and  6.0 

(4.30) 
o2^  =  1.0  and  4.0. 

Having  obtained  the  critical  values,  Imhof's  Procedure  in 
Appendix  G  (after  transforming  the  vector  ^   to  obtain  the  power  of 
the  appropriate  quadratic  form  (see  (4.8)))  was  used  to  obtain  the 
approximate  tests. 

Now,  recall  that  the  exact  test  derived  for  testing  the 
hypothesis  H^  ■' :  ol    =  0,  is  of  the  form 


^u-t/^^-^) 


tl      ^-^^^^^Kt'1){s-\) 


where  w^  i  and  w^2  ^"^^   described  in  (3.82)  and  are  distributed  as 


~tl     (r-1)'-'-   ^   3    ctS    max  e^  ■' 
and 

~t2     (r-l(s-l)'-~   ^  aB    max  &■' ^ 


Hence,  under  the  hypothesis  H^ :  ag  *  0, 

a2,  +  X^   a2     "^ 
F   ~      «S    max  e        ,  (4.31) 

^tl      2  .  2   ^  ,t   0       ^,r-l,(r-l)(s-l)'   ^  ''" 

B  aB    max  e 

where  F    ,  rr-l)(s-l)  "'"^  ""^^  upper  a-percentile  point  of  an  F 
distribution  with  (r-1)  and  (r-l)(s-l)  numerator  and  denominator 

degrees  of  freedom,  respectively.   Consequently,  the  power  of  F^.  ^ 

(2) 
for  testing  Hp^   ,  is  given  by 
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gp         nax    e 

ra2+a2^+A        a^ 
S      aS      max   e 


^1  > 


gg   max  e 

ra2+a2  +A   a^ 
6   ae   max  e 


a,r-l,(r-l)(s-l) 


"   ^f^r-l,(r-l)(s-l)   ^   ^    *    ^a,r-l,(r-l)(s-l)J' 


(4.32) 


where   9 


1    +   ra2/(a2    +x'      a2  ) } 
6        ci6      max    e^  ■' 


-1 


As  a  result,  the  powers  for  F  j^  were  simply  obtained  by  specifying 
values  for  ol    and  a2   (see  (4.30))  and  using  the  PROBF  function  in 
SAS  (1985).   The  function  PROBF  computes  the  probability  that  a 
random  variable  having  an  F  distribution  with  specified  numerator 
and  denominator  degrees  of  freedom  falls  below  a  given  value. 
Note  that  we  specify  the  critical  value  9  *  F^  ^_^    (r-l)(s-l)  ^"'^ 
use  1-FROBF  to  obtain  the  powers  of  F^j^. 

The  exact  test  derived  for  testing  the  hypothesis 
H*-^^:  a,  =  ^2  ^  •*•  ^  °'r'  ^^    °^    ^^^    form 


F  (H)  = 


I      (r  G  *R    I    /(r-1) 
~a  ^ X   ^   ~a 

SSE*/(r-l)(s-l) 


where  1      and  SSE   are  described  in  (3.102)  and  (3.105), 
~a 

respectively.   Under  H^  ^ 


F*(H)  ~  F'[r-1,  (r-l)(s-l),  (r  a-m  )'(r   G  *R  )   (Ra-m)/2a' 
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*2  F    , 

where  a       =   a^ ^   +  X        a^  . 
a3    max  e 

The  noncentrality  parameter  is  determined  by  specifying  a 
value  for  a^g  (without  loss  of  generality  we  set  a^  =  1)  and 
values  for  the  fixed  effects  under  H^   .  not  vS       .      Once  again  the 
PROBF  function  in  SAS  is  used  to  obtain  the  powers  of  interest 
(note:   the  function  PROBF  allows  us  to  specify  noncentrality 
parameter  values). 

As  mentioned  above,  we  need  to  consider  values  for  the  fixed 
effects  under  H^   .   Two  vectors  for  a  were  considered.   These 
were  ordered  according  to  their  Euclidean  norms  as 


0.5 
0.75 
1.0 
1.25 


(4.33) 


(Note:   in  Table  4.7  Designs  1,  2,  3  and  4  use  the  first  two 
elements  of  the  vectors  in  Equation  4.33  above.) 

The  last  component  of  the  power  study  concerns  the  designs  to 
consider  in  the  study.   As  with  tlie  2-fold  nested  model,  the  suras 
of  squares  in  the  analysis  of  variance  table  for  unbalanced  two- 
way  cross  classification  designs  no  longer  have  the  distributional 
properties  found  in  balanced  designs.   Since  the  degree  of 
deviation  from  complete  balance  may  affect  the  power,  we 
considered  designs  with  low  and  high  degrees  of  imbalance. 
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Khuri  (1986),  proposed  a  measure  of  departure  from  complete 
balance  for  a  two-way  cross  classification  model  given  by 


1 


l+c2 
4 


(4.34) 


where 


2 
^^4  = 


[n.  .  -  n   /(rs)]2 
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Table  4.5.   Designs  Used  in  the  2-Way  Cross  Classification  Power 
Study  (({)/  is  a  measure  of  departure  from  complete 
balance) . 


DESIGN  1 

N  =  36      ^,  =  0.35 

r=2;  s=2; 

ni,=30,  n,^=3;   n^ , =2 ,  n^^=l; 

DESIGN  2 

N"  =  36      ^/^  =  0.96 

r=2;  s=2; 

n  1  1  =7  ,  ni9  =  12;   noi=8,  n';,n=9; 

DESIGN  3 

N  =  36      (j),  =  0.35 

r=2;  s=3; 

111, =23,  n,^=9,  n,o=l;   n^i  =  l,  noQ  =  l,  n^n=l; 

DESIGN  4 

N  =  36      <t",    =   0.96 

r=2;  s=3; 

nii=5,  ni'j  =  5,  n,')  =  7;   n9,=5,  noo=6,  n^o=8; 

DESIGN  5 

N  =  36      (J)^  =  0.35 

r=4;  s=2; 

iill  =  20,  n^2=6;   "21"^'  "22"^'  "3l"^'  "32"'^5  ^4^  =  1,  r\i^2"]. , 

DESIGN  6 

N  =  36      d),  =  0.96 

r=4;  s=2; 

"11"^'  "12'"'^'   "21"-^'  "22=6;  n3j^=4,  "32=4;  n^^  =  5,  n^2  =  5; 
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4.2.3 


Results 


Table  4.6.   Power  values  for  Testing  the  Random  Main  Effects  in 
the  Two-Way  Cross  Classification  Mixed  Model 


Design 


2 

"l 

1 

.5 

6.0 

4 

.5 

6.0 

1 

.5 

6.0 

4 

.5 

6.0 

1 

.5 

6.0 

4 

.5 

6.0 

1 

.5 

6.0 

4 

.5 

6.0 

1 

.5 

6.0 

4 

.5 

6.0 

1 

.5 

6.0 

4 

.5 

6.0 

a   = 

.05 

pprox. 

Exact 

.368 

.063 

.512 

.138 

.222 

.055 

.281 

.093 

.237 

.069 

.498 

.168 

.129 

.056 

.193 

.098 

.334 

.073 

.513 

.269 

.164 

.059 

.252 

.152 

.068 

.088 

.280 

.367 

.053 

.061 

.149 

.169 

.192 

.110 

.429 

.443 

.080 

.075 

.122 

.279 

.125 

.142 

.494 

.527 

.068 

.079 

.265 

.304 

ci  =  .10 
Approx.   Exact 


1  (2x2) 


2  (2x2) 


3  (2x3) 


4  (2x3) 


5  (4x2) 


6  (4x2) 


35 


,96 


.35 


,96 


,35 


,96 


,433 
.621 

,274 
.368 

.339 
.515 

.172 
.286 

.405 
.647 

.221 
.363 

.141 
.465 

.120 
.253 

.255 
.548 

.131 
.329 

.217 
.605 

.140 
.398 


125 
,266 

110 
,184 

,137 
,316 

,111 
.193 

,143 
.438 

,118 
.274 

.169 
.550 

.121 
.300 

.195 
.560 

.141 
.400 

.238 
.634 

.147 
.428 
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Table  4.7.   Power  values  for  Testing  the  Fixed  Effects  in  the 
Two-Hay  Cross  Classification  Mixed  Model. 


[Si     =  1  corresponds  to  ^^  , 

a^   =    2   corresponds  to  )j2(s^^  4.33);  ^l    is  a  measure 

of  departure  from  complete  balance.) 


(I  =  type  I  SS,  II  =  type  II  SS,  E  =  Exact) 


Design 


3,' 


A, 


type 


a  =  .05 


.10 


(2x2) 


,35 


1     .5 


6.0 


4     .5 


6.0 


1     .5 


6.0 


4     .5 


6.0 


I 

.003 

.026 

II 

.060 

.097 

E 

.051 

.102 

I 

.006 

.037 

II 

.063 

.109 

E 

.051 

.102 

I 

.010 

.047 

II 

.067 

.082 

E 

.050 

.100 

I 

.014 

.052 

II 

.010 

.098 

E 

.050 

.100 

I 

.018 

.047 

II 

.067 

.113 

E 

.374 

.667 

I 

.021 

.052 

II 

.077 

.120 

E 

.374 

.667 

I 

.057 

.072 

II 

.099 

.131 

E 

.229 

.437 

I 

.081 

.099 

II 

.110 

.130 

E 

.229 

.437 
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Table  4.7  -  continued 


(I  =  type  I  SS,  II  =  type  II  SS ,  E  =  Exact) 


Design 


'I, 


type 


ci  =  .05 


a  =  .10 


2  (2x2) 


,96 


I 
II 

E 


,007 
.041 
,051 


,037 
.083 
,103 


6.0 


I 
II 

E 


,017 
,047 
,051 


,057 
,094 
,103 


.5 


I 

II 

E 


,019 
,040 
,050 


,060 
.081 
,101 


6.0 


I 
II 


,026 
,053 
,050 


.071 
.101 
.101 


.5 


I 
II 


.026 
.100 
.445 


,062 
.125 
,760 


6.0 


I 
II 

E 


,076 
,158 
,445 


,  L13 
,196 
7  60 


.5 


I 
II 

E 


,082 
.159 
,243 


.134 
.214 
.462 


6.0 


I 
II 

E 


,113 
,163 
,243 


.153 
,238 
.462 


3  (2x3) 


.35 


.5 


I 
II 

E 


.002 
.023 
,051 


,019 
.065 
,102 


6.0 


I 
II 

E 


,010 
,032 
,051 


,041 
,078 
,102 


.5 


I 
II 

E 


.018 
.039 
.050 


,056 
.088 
,101 
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Table  4.7  -  continued. 


(I  =  type  I  SS,  II  =  type  II  SS,  E  =  Exact) 
Design      ^,  a^ 


2 

i 

type 

a  =  .05 

a  = 

6.0 

I 

.024 

.067 

II 

.042 

.092 

E 

.050 

.101 

1 

.5 

I 

.039 

.061 

II 

.132 

.185 

E 

.756 

.936 

6.0 

I 

.054 

.073 

II 

.150 

.198 

E 

.756 

.936 

4 

.5 

I 

.061 

.076 

II 

.081 

.193 

E 

.448 

.687 

6.0 

I 

.072 

.081 

II 

.192 

.201 

E 

.448 

.687 

1 

.5 

I 

.010 

.042 

II 

.037 

.082 

E 

.052 

.104 

6.0 

I 

.016 

.066 

II 

.035 

.083 

E 

.052 

.104 

4 

.5 

I 

.026 

.067 

II 

.040 

.083 

E 

.051 

.101 

6.0 

I 

.033 

.075 

II 

.051 

.082 

E 

.051 

.101 

I 

.5 

I 

.042 

.071 

II 

.076 

.083 

E 

.901 

.989 

4  (2x3) 


.96 
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Table  4.7  -  continued. 


(I  =  type  I  SS,  II  =  type  II  SS,  E  =  Exact) 


Design 


'4 


2 

a6 

4 

type 

a  =  .05 

a  = 

6.0 

I 

.065 

.082 

II 

.081 

.095 

E 

.901 

.989 

4 

.5 

I 

.066 

.085 

II 

.081 

.099 

E 

.502 

.744 

6.0 

I 

.073 

.093 

II 

.109 

.162 

E 

.502 

.744 

1 

.5 

I 

.005 

.023 

II 

.031 

.074 

E 

.057 

.113 

6.0 

I 

.011 

.040 

II 

.036 

.080 

E 

.057 

.113 

4 

.5 

I 

.020 

.059 

II 

.038 

.091 

E 

.053 

.105 

6.0 

I 

.025 

.063 

II 

.050 

.105 

E 

.053 

.105 

1 

.5 

I 

.063 

.096 

II 

.087 

.099 

E 

.717 

.895 

6.0 

I 

.094 

.114 

II 

.101 

.131 

E 

.717 

.895 

4 

.5 

I 

.098 

.238 

II 

.133 

.269 

E 

.376 

.585 

6.0 

I 

.196 

.268 

II 

.225 

.312 

E 

.376 

.585 

5  (4x2) 


.35 
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Table  4.7  -  continued. 


(I  =  type  I  SS,  II  =  type  II  SS ,  E  =  Exact) 
Design      ^ r  a^ 


2 

"1 

type 

a   =    .05 

a   = 

1 

.5 

I 

.006 

.024 

II 

.028 

.062 

E 

.060 

.119 

6.0 

I 

.012 

.041 

II 

.039 

.084 

E 

.060 

.119 

4 

.5 

I 

.023 

.061 

II 

.038 

.081 

E 

.053 

.106 

6.0 

I 

.028 

.066 

II 

.042 

.084 

E 

.053 

.106 

1 

.5 

I 

.031 

.046 

II 

.096 

.123 

E 

.862 

.969 

6.0 

I 

.054 

.07  3 

II 

.114 

.191 

E 

.862 

.969 

4 

.5 

I 

.123 

.159 

II 

.173 

.217 

E 

.421 

.637 

6.0 

I 

.202 

.261 

II 

.298 

.352 

E 

.421 

.637 

6  (4x2)    .96 
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4.2.4    Analysis  of  Power  Study 


Consider  Table  4.6,  where  we  have  compared  the  power  values 
for  an  approximate  test  and  the  derived  exact  test,  used  in 
testing  the  variance  component  associated  with  the  random  main 
effect.   The  power  of  the  approximate  test,  for  a  fixed  value  of 
a^o,  appears  to  be  an  increasing  function  of  a, .   However,  when  we 
fix  On,    the  power  for  this  test  is  a  decreasing;  function  of  O'tn  ' 
When  we  hold  constant  the  levels  of  the  fixed  main  effects  and  the 
levels  of  the  random  main  effects,  and  compare  the  designs  only  by 
changing  the  degree  of  imbalance  (that  is,  different  values  for 
the  n-.'s),  we  find  that  except  for  Designs  5  and  6,  the  power  of 
the  approximate  test  is  larger  for  the  design  with  the  higher 
degree  of  imbalance. 

The  power  of  the  exact  test  behaves  in  a  similar  fashion. 
That  is,  if  we  hold  a^g  constant,  the  power  is  an  increasing 
function  of  a? ,  and  when  we  fixed  a'i    the  power  is  a  decreasing 
function  of  cj^q  .   However,  unlike  the  approximate  test,  the  exact 
test  performs  better  when  the  design  has  a  lower  degree  of 
imbalance.   In  addition,  note  that  when  we  hold  the  levels  of  the 
fixed  effects  constant,  and  change  the  number  of  levels  for  the 
random  main  effects,  the  power  of  the  exact  test  is  larger  for 
those  designs  with  more  levels  in  the  random  main  effects  (compare 
Design  1  and  2  against  Designs  3  and  4).   A.  similar  increase 
occurs  when  we  hold  the  levels  of  the  random  main  effects  fix,  and 
increase  the  number  of  levels  of  the  fixed  effects. 
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Note  that,  with  the  exception  of  Designs  5  and  6  (both  4x2), 
in  general,  the  power  of  the  approximate  test  does  better  than  the 
power  of  the  exact  test.   Unlike  the  exact  test,  in  general  the 
results  from  this  table  do  not  indicate  an  increase  in  the  power 
of  the  approximate  test  when  we  increase  the  levels  of  either  main 
effect  (the  random  or  fixed).   Consequently,  1  recommend  using  the 
exact  test  when  we  have  a  larger  number  of  levels  for  either  the 
random  or  fixed  main  effect.   la  addition,  since  it  appears  that 
the  approximate  test  is  a  decreasing  function  of  the  degree  of 
imbalance,  whereas,  the  exact  test  is  an  increasing  function,  I 
recommend  using  the  exact  test  for  those  designs  with  a  lower 
level  of  imbalance. 

Consider  Table  4.7  whose  contents  are  the  power  values  for 
the  type  I  and  type  II  approximate  tests  in  addition  to  the  power 
values  for  the  exact  test.   We  immediately  notice  the  complete 
domination  of  the  type  II  powers  compared  to  the  type  I  powers, 
however,  it  is  still  of  interest  to  study  the  results  of  the  type 
I  test  and  compare  them  to  the  exact  test. 

We  find  that  when  we  fix  a^„  the  type  I  powers  are  an 
increasing  function  of  the  variance  component  a^ .   Similarily, 
when  we  hold  a?  constant  the  type  I  powers  are  an  increasing 
function  of  o\o-      The  relationship  of  the  type  II  powers  and  the 
variance  components  is  identical  to  the  relationship  we  found  for 
the  type  I  powers. 


-165- 


Note  that  the  powers  of  the  exact  test  are  independent  of  the 
variance  component  associated  with  the  random  main  effect,  that 
is,  Og.      As   expected,  the  power  of  the  exact  test  is  a  decreasing 
function  of  the  variance  component  associated  with  the  random 
interaction  effect,  o^„.      Comparison  of  Designs  1  and  5  or  Designs 
1  and  3  (for  a  =  2),  appears  to  indicate  that  an  increase  in  the 
number  of  levels  of  either  effect,  increase  the  power  of  the  exact 
test. 

The  exact  test,  in  general,  appears  to  have  greater  power 
than  both  the  type  I  and  type  II  approximate  tests  as  one  can 
observe  for  the  designs  in  Table  4.7.   However,  the  powers  of  the 
approximate  tests  are  not  very  reliable  because  of  the  simulation 
employed.   Hence,  further  studies  with  a  better  technique  for 
obtaining  the  critical  values  of  the  approximate  tests  will  need 
to  be  considered. 


CHAPTER  FIVE 
FUTURE  RESEARCH 


The  two  models  considered  in  CHAPTER  THREE,  the  2-fold  nested 
mixed  model  and  the  two-way  cross  classification  mixed  model  have 
been  studied  under  certain  assumptions  that  may  not  always  hold 
true.   In  the  derivations  we  assumed  that  a  particular  set  of 
random  effects  had  a  variance-covariance  structure  which  could  be 
expressed  as  an  unknown  parameter  (the  variance  component)  times 
the  identity  matrix.   It  is  possible  that  situations  may  arise 
where  correlations  exist  within  a  particular  set  of  random  effects 
in  which  cases  the  identity  matrix  does  not  appear  in  the  variance 
structure  of  the  effects. 

In  addition,  correlations  may  exist  across  two  sets  of  random 
effects.   We  have  assumed  in  the  past,  for  instance,  that  the 
random  main  effect  and  random  interaction  effect  in  the  two-way 
cross  classification  model  are  independently  distributed.   The 
derivations  were  based  on  this  assumption.   Again,  it  is  possible, 
and  indeed  more  realistic  to  assume  that  this  assumption  may  be 
violated  in  certain  situations. 

A  more  pressing  future  research  area  is  the  determination  of 
the  eigenvectors  (used  in  the  frequent  transformations  in  the 
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process  of  arriving  at  a  diagonal  variance-covariance  structure) 
that  will  provide  optimal  power  values  for  the  test. 

Finally,  generalizations  of  the  proposed  exact  techniques  to 
more  complex  models  should  be  considered.   Such  generalizations  in 
the  case  of  nested  models  will  not  present  any  problems  if  there 
is  only  a  single  set  of  random  effects  with  stages  of  higher 
hierachy  being  associated  with  fixed  effects.   However,  most 
nested  models  involve  only  one  set  of  fixed  effects,  occurring  at 
the  first  stage,  with  the  remaining  effects  having  some  type  of 
random  distribution.   Once  we  consider  more  than  one  set  of  random 
effects  in  the  nested  models,  the  above  derivations  fail  because 
we  are  not  able  to  simultaneously  diagonalize  the  matrices 
involved  in  the  variance-covariance  structure  of  the  vector  of 
observations. 

Unlike  the  nested  models,  the  two-way  cross  classification 
mixed  model  studied  in  CHAPTER  THREE,  had  a  variance-covariance 
structure  involving  two  matrices  that  we  could  simultaneously 
diagonalize.   This  was  necessary  since  the  model  had  two  sets  of 
random  effects.   However,  more  complex  cross  classification 
models,  such  as  the  three-way  cross  classification  model  involving 
more  than  two  sets  of  random  effects,  will  lead  to  variance- 
covariance  structures  requiring  the  simultaneous  diagonalization 
of  more  than  two  matrices.   Obviously,  we  are  left  with  numerous 
research  problems  to  consider  in  the  years  to  come. 


APPENDIX  A 
THE  EIGENVALUES  OF  THE  MATRIX  A^  IN  EQUATION  3.4 

The  matrix  A,,  defined  in  equation  (3.4),  has  the  following 

eigenvalues : 


and 


"a"  positive  eigenvalues:   ra, ,  m^ , 


a  zero  eigenvalue  of  multiplicity  m^ -a , 


where  m.  is  the  number  of  levels  of  factor  B  nested  within  level  i 
of  factor  A  (i  =  1,  2,  ...,  a). 

Proof:  From  (Graybill  1984,  p.  229,  Theorem  8.8.16)  if  X^^^  for 
j  =  l  ,2 ,  . . .  ,in.  are  the  eigenvalues  of  W.  for  i=l,2,...,a  (where  W. 
is  an  m.xm.  matrix),  then  X\^^    for  i=l , 2 , . . . ,m . ;  i=l,2,...,a  are 

11  J  J>»7]^'  777 

a  a 

the  eigenvalues  of   §  W.  .   We  have  A,  =  B-B'T,  where  B,  =   (^  1 

.     ,      1  ill  1         .      ~m. 

1=1  1=1      1 

Hence,    A,    can   be    expressed   as 


A,    =     /        §      1       ]     {       §      1 
^  [     i  =  l    ^\        \    i  =  l    ~^ 


®    1     I    (     »    r 

.    ,    ~m.  /     \     .    ,    ~m. 
1=1         1/      \  1=1         1. 
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»    1    r    =    §  J 

.  ,  ~m .'■Til .    .  ,  m . 
1=1    11    1=1   1 


Now,  determine  the  eigenvalue  of  J    for  i-l,2,...,a.   That  is, 

i 

solve  the  characteristic  equation: 


J   -  XI    =  0,  for  i=l,2,.  ..  ,a. 
'  m.      m. I 


The  determinant  I J   -  XI     is  equal  to 

I   m         ml 


m.      m. 


J    -  XI 
'  m.      m, 


1-X   1 
1   1-X 


1    1-X 


m.-l 


(1-X)  +  (m.  -  1)  .  1J[1-X-1, 


=   X-m.  X 


m.-l 

1 


(see  Graybill  1984,  p. 230,  Theorem  8.9.1).   This  implies  that  the 
matrix  J^^  has  eigenvalues,  X  =  m^^  with  multiplicity  equal  to  one, 
and  X  =  0  with  multiplicity  equal  to  m.  -  1  for  i=l,2,...,a. 


Since,  A   = 


J   ,  it  follows  from  the  theorem  described  in  the 


i  =  l 
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beglnning  of  the  proof,  that  A,  is  a  matrix  with  eigenvalues 


ip  m2, 


,  m     each  having  multiplicity  one,  and  zero  having 


multiplicity  equal  to  ra.-a. 


APPENDIX  B 

THE  EIGENVECTORS  ASSOCIATED  WITH  THE  POSITIVE  EIGENVALUES 

OF  THE  MATRIX  Aj  OF  EQUATION  3.4 

The  matrix  A,,  defined  in  (3.4),  has  the  following 

eigenvectors  associated  with  the  positive  eigenvalues: 

-  V2,(i)'   .    .  ,  , 
m.   ^1      for  1=1  ,2  , .  .  .  ,a 


where 


''"'  =  [1-    ■■<>,,       >■ 

~        L^m    ~lx(m^-m  )- 


1=["0     'l^'O 

'■~lxm,  ■  ~m_  ■  '-Ixfrn  -(ra,+n„)' 


1^^^'  =  [0,  ,     ^  :  1'  ]  . 
'^  '-~lx(m  -m  )   ~ra  -' 


C  J  ■» 
Proof:   Consider  A.J.'^'^-,  where  £  =  1,  2,  ...,  a. 


A  ,1^^)  =  I      J   1^^) 
1~      .  ,   m.~ 
1=1    1 
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®J        0     »0     »...»!        ...§0      11 
1=1      1         1  2  i  a 


(where    0        is    an   m.xl    column   vector    of    zeroes) 


(j      0     »   J     0     9 
m.~m,         m^^-^^ 
1       1  2      2 


J      1      ( 


.    §   J      0        1 
m  ~m  ^~a 
a      a 


«*...§  m„l      *    ...»   0      11 
1,  i-m^  ~m  ^~a 

1  £  a 


=   ™jii 


(£) 


From  Appendix  A  we  know  that  ttIj,  is  an  eigenvalue  of  A,;  hence, 
J^^^  must  be  an  eigenvector  of  A,  corresponding  to  the  eigenvalue 
ra„  .   Since,  £  was  arbitrarily  chosen,  it  follows  that  m.  '^  I 
for  i=l,2,...,a  are  eigenvectors  of  A,  associated  with  the 
eigenvalues  ra.  for  i=l,2,...,a,  respectively. 


APPENDIX  C 
THK  EIGENVALUES  OF  THE  MATRIX  C  A^C^  IN  EQUATION  3.68 

The  matrix  C  A2C^  from  (3.68)  has  eigenvalues  r  and  0  with 

multiplicity  equal  to  s-1  and  (r-l)(s-l),  respectively. 

Proof: 

C  A^C"  =  (I  X  T)(J  X  I  )(i  X  T") 
t  2  t     r      r   s    r 

=  (J  X  T)(l  X  T') 
r      r 

=  J  X  I 
r   s-1 

We  first  obtain  the  eigenvalues  of  J  ,  that  is,  we  obtain  the 

solution  to  the  characteristic  equation: 

|j   -  All  =  0. 

But,  |j^  =  Xl|  =  (X-r)X'^"^,  from  Graybill  (1984,  p. 230,  Theorem 

8.9.1).   Hence,  J   has  an  eigenvalue  equal  to  r  with  multiplicity 

one  and  an  eigenvalue  equal  to  zero  with  multiplicity  r-1.   It 

follows  from  Graybill  (1984,  p. 229,  Theorem  8.8.16)  that  the 

matrix  C  a „C'  =  J  x  i     has  eigenvalues  r  and  0  with 
t  2  t    r    s-1       ^ 

multiplicity  equal  to  s-1  and  (r-l)(s-l),  respectively. 
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APPENDIX  D 
THE  PRODUCT  OF  TILE  MATRIX  T  (3.66)  AND  ITS  TRANSPOSE 

The  matrix 


T  = 


1//2 

-1//2 

0 

• 

l//"6 

\Hl 

-iHl 

0 

1 

1 

, 

/sCs-l)      /s(s-l 


0 
0 

-(s-1) 
/s(s-l) 


with  (s-1)  rows  and  s  columns  has  the  following  property 


T'T  =  I J  . 

s   s   s 


Proof:   By  mathematical  induction.   Consider  s=2  (that  is,  T  has  1 
row  and  2  columns): 


T'T  = 


\_ 

J_ 

j2i 

/2 

/2 

/2 

-1 

/2 

-174- 


175- 


1 

2 

1 
2 

1 
2 

1 
2 

■"-2    2  '^2 


Now  assume  the  property  holds  for  s  =  t  and  show  that  for 

1 


s  =  t+1,  T'T  =  I 
expressed  as 


t+1    (t+1)   t+1 


J    .   When  s  =  t+1,  T  can  be 


5(t-l)xl 

-t 
/t(t+l) 


where 


"t  _ 


1//2 
1//6 

-1//2 
1//6 

0 

-2//'6 

1 

I 

1 

_/t(t+l)        /t(t+l)        /t(t+l) 


0 
0 

-(t-1) 
/t(t+l) 


(t-l)xt 
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/t(t+l)    /t(t+l) 


1 
/t(t+l) 


Ixt 


Note  by  our  assumption  that  the  property  holds  for  s=t, 

T'T  =1 J   . 

t  t    t    t   t 

Hence , 


T'T 


T'T  +  h'h 
t  t   ~t~t 


/t(t+l) 


/t(t+l) 

t2 
t(t+l) 


h' 
~t 


1 


^t    t  '^t  ^  t(t+l)  "t 


-1 


(t+1)  ~t 


-1 


(t+1)  -it 

t 
t+1 


"t+1 


^J.  --^^J 


1 


(t+1)  ~t 


1 


t   t    t(t+l)   t        (t+1)  ~t 


1 
t+1 


=  I 


t+1    (t+1)   t+1 
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Hence,  by  induction,  in  general  for  s  >  2 


T'T  =  I   -  -  J  . 
s    s   s 


APPENDIX  E 

COMPUTER  PROGRAf'l  TO  OBTAIN  EXACT  TESTS  FOR  THE  RANDOM  AND  FIXED 

EFFECTS  IN  AN  UNBALANCED  2-FOLD  NESTED  MIXED  MODEL 

****************************************************************** 

*  NOTE  THAT  THE  MACRO  HAS  BEEN  STRUCTURED  TO  ALLOW  A  MAXIMUM    * 

*  OF  6  LEVELS  FOR  THE  NESTING  FIXED  EFFECT  * 

*  AND  3  LEVELS  FOR  NESTED  RANDOM  EFFECT  * 


ASSUMPTION:  N  >  2B    (N  =  ^n^. ,   B  =  Em^) 


****************************************************************** 
MACRO  EXACT  (Rl 1 , R12 , R13 ,R21 , R22,R23,R3 1 ,R32,R33 ,R41 , R42 ,R43 ,R5 1 , 

R52,R53,R61 ,R62,R63,M1 ,M2 ,M3 ,M4 ,M5,M6 ,N,RRA) ; 
PROC  MATRIX; 
FETCH  Y  DATA  =  Z; 

%IF  %LENGTH(6R11)  =  0  %THEN  %GOTO  LVNll; 

Ml    =   &M1; 

Nl    =   &R11; 

RINll  =   1#/N11; 

V     =   1#/N11; 

RXXll  =  J. (Nil, Nil, RINll); 

GG    =   RXXl  1 ; 

VMl    =   J.(&M 1,1,1); 
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W  =  BLOCK(V;il); 

B  =  &M1; 

S  =  Ml-1; 

YVI  =  &SUM(Y(l:Nll,))y//Nll; 

IF  Ml  =  3  THEN  DO; 

CU  =  1#/(SQRT(2)); 

C12  =  -1#/(SQRT(2)); 

C13  =  0; 

C21  =  1?//(S0RT(6)); 

C22  =  1#/(SQRT(6)); 

C23  =  -2#/(SQRT(6)); 

CONT  =  (Cll|  |C12|  |ci3)//(C2l|  |C22|  |C23);EN'D; 

IF  Ml  =  2  THEN  DO; 

Cll  =  1#/(SQRT(2)); 

C12  =  -1#/(SQRT(2)); 

CONT  =  Cll| |C12;END; 
LVNll:   %IF  LENGTH(&R12)=0  %THEN  %GOTO  LVN12; 

N12  =  &R12; 

RIN12  =  1#/N12; 

RXX12  =  J.(N12,N12,RIN12); 

GG  =  BL0CK(GG,RXX12); 

V  =  v| |rIN12; 

SS  =  N11+N12; 
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LVN62:  %IF  %LENGTH(&R63)=0  %THEN  %GUTO  LVN63; 

N63  =  &R63; 

RIN63  =   1#/N63; 

RXX63  =   J.(N63,N63,RIN63); 

GG  =   BLOCK(GG,RXX63); 

V  =   v||rIN63; 

LVN63:   YVI  =  YVI//(SUM(Y( SS+1 :SS+N63, ) ) )#/N63 : 


GGl 

=   GG; 

Bl 
WS 

=   VV; 
=   &N; 

A 

=  &RRA;UNUM  = 

=  A-1; 

11 

=   KB); 

12 

=   I(WS); 

15 

=  I(S); 

Rl 

=  S; 

NT2 

=  WS-B; 

N2 

=  B-A; 
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OB         =  J.(B,1,1); 

K  =   DIAG(V); 

*********************************  *A  A  *!k)k*  A  ******  A  ************  AAA** 

*  I.   AN  EXACT  TEST  FOR  THE  VARIANCE  COMPONENT  ASSOCIATED  WITH  * 

*  THE  RANDOM  NESTED  EFFECT  * 

AAA *********** A****** **AA****AAAA A AA*AA**AAA****** A ***A**A*******j 

Z       =   CONT*YVI; 

Kl      =   CONT*K*CONT  %STR(%'); 

QB      =   Z  %STR(%')*INV(K1)*Z; 

CW      =   I2-GG1; 

SSE     =   Y  %STR(%')*CW*Y; 

****AAAAAAAAAA*******A****** ******************************* ******* 

FB    =   (QB#/R1)///(SSE#/NT2); 


**AA*A*A*A A AAAAAAAAA***********AA*A* ********************* 

*      II.   AN  EXACT  TEST  FOR  THE  FIXED  EFFECTS  * 

**************** A A A* *********************** *************** 

LAMAX         =   MAX(EIGVAL(K)); 
EIGEN         E   HHl  CW; 
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HHl 
HI 

MATl 
EIGEN 
DO  I 


Mill 
MAT  2 


=   HHl  %STR(%'); 

=   HH1(1:B,); 

=   (LAMAX*I1  -  K); 

MMl  MM2  MATl; 

=  1  TO  B; 

IF  :>1M1(I,1)  <  .00001  AND  MMl  (1,1)  >  -.00001  THEN 
MI'!1(I,1)  =  SQRT(MM1(I,1)); 

=  diag(m;-ii); 

=  mm2*mm1*mm2  %str(%'); 

=  yvi  +  mat2*h1*y; 


*  OBTAIN  A  SOLUTION  FOR  THE  VECTOR  OF  FIXED  EFFECTS   * 

*  USING  THE  NORMALIZED  EQUATIONS  * 


GXPX 
ES 


=   0B||B1; 

=   GINV(X  %STR(%')*X) 
=   GXPX*X  %STR(%')*W; 


01  =   J.(UNUM,1,0); 

R  =  1  -1  0  0/ 

0  1-10/ 

0  0  1-1; 
R  =  R(1:A-1,1:A); 
R  =  01  I  JR; 
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LA  =  R*ES; 

*  NUMER/\TOR  OF  THE  TEST  STATISTIC  * 

A***A5k  ■>  ***********************************  **)!c*>ic*****A**- 

QA  =   (LA  ZSTRiZ')*    INV(R*GXPX*R  %STR(  %  '  )  )*LA)#/UNU1-1 : 

*  DENOMINATOR  OF  THE  TEST  STATISTIC  * 

*******************************************************. 

J 

SSE2  =   (W  %STR(%')*(I1  -  X*GXPX*X  %STR(% ' ) )*W)#/N2 ; 

******************************************************* 

*  TEST  STATISTIC    FH  * 
******************************************************* • 

FH  =   QA#/SSE2; 

MAT  =   Fb| |ri| |nT2| |fh| JuNUM| |n2; 

OUTPUT  MAT  OUT   =   NEW( RENAME   =   (COLl   =  FB  C0L2   =  Rl 

C0L3   =    NT2  COLA   =   FH 
COLS   =   UNUM   C0L6   =   N2 ) ) ; 

DATA  NEW; SET  NEW; 
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PVl  =  1  -  PR0BF(FB,R1,NT2); 
PV2  =  1  -  PR0BF(FH,UNUM,N2); 
PROC  PRINT;  VAR  FB  Rl  NT2  PVl  FH  UNUM  N2  PV2; 

********  AA**>!c-A***A*A****  A-/c  A  ********:*!  A  Aj^c^A/i  A  A**;!:  A  ************  A**** 

*  PVl  =  power  for  the  exact  test  of  random  effects        * 

*  PV2  =  power  for  the  exact  test  of  fixed  effects.        * 

**A*A**AAAA***AAAA*AAAAA*AA*AAAA*A*******A***A*****A*****AAAAA*A*' 


APPENDIX    F 

COMPUTER    PROGRAM    TO    OBTAIN    AN    EXACT    TEST    FOR   THE    RANDOM 

AND    FIXED    EFFECTS    IN    AN    UNBALANCED    TWO-VJAY   CROSS 

CLASSIFICATION   MIXED   MODEL 

***  A -;c********V;  *******  *A***Ai!cA***A:!cA**A*  ************************  A* 

*  NOTE:   THE  MACRO  HAS  BEEN  STRUCTURED  TO  ALLOW  A  MAXIMUM  OF    * 

*  -  4  LEVELS  FOR  THE  FIXED  MAIN  EFFECT  -  A  * 

*  -  4  LEVELS  FOR  THE  RANDOM  MAIN  EFFECT  -  B  * 

*  * 

*  ASSUMPTION:  N  >  MAX( 2AB-A, 2AB-B)    (N  =  ^n^.)  * 

*****************************************************************. 

» 

OPTIONS  NONOTES; 

%MACRO  EXACT2(Nll,N12,N13,N14,N21,f^22,N23,N24,N31,N32,N33,N34,N41, 

N42,N43,N44,N,A,B); 
PROC  MATRIX; 
FETCH  Y  DATA  =  A; 
N  =  &N; 

A  =  &A;  B  =  &B;  G  =  (A-1 ) ; 
RS  =  A*B; 
Nl  =  (B-1); 
Dl  =  (A-1)*(B-1); 
N2  =  Dl; 
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D2  =  N-2*A*B  +  A; 

%IF  %LENGTH(&N11)  =  0  %THEN  %GOTO  LVN12; 
Nil   =  &N11; 
Xll   =  1#/N11; 
K    =  Xll; 

JJ   =  J. (Nil, Nil, Xll); 
YVAR  =  (SUM(Y(1:N11,)))#/N11; 
%LVN12:  %IF  '^LENGTH(&NI2)  =  0  %THEN  %GOTO  LVN13; 
N12   =  &N12; 
X12   =  1///N12; 
K    =  BL0CK(K,X12); 
JJ    =  BL0CK(JJ,J.(N12,N12,X12)); 
SS   =  N11+N12; 
YVAR  =  YVAR//(SUM(Y(N11+1:SS,)))#/N12; 


%LVN4A:  %IF  %LENGTH(&N44)  =  0  %THEN  %GOTO  LVN51; 
N44   =  &N44; 
X44   =  1#/N44; 
K    =  BL0CK(K,X44); 
JJ    =  BLOCK(JJ,J.(N44,N44,X44)); 
YVAR  =  YVAR//(SUM(Y(SS+1:SS+N44,)))#/N44: 
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*A*A  *********************  AAA*  *7!c**A*AA*>!c***!!cAA*****'!!c*5'c** 

*    I.   A  TEST  FOR  THE  FIXED  EFFECTS  OF  THE  MODEL      * 
******************************************************** 

3 

********************************************************* 

*  DETERMINE  THE  ORTHOGONAL  MATRIX  THAT  SIMULTANEOUSLY  * 

*  DIAGONOLIZES  BOTH  Al  AND  A2  (WHERE  Al  AND  A2  ARE     * 

*  ASSOCIATED  WITH  THE  FIXED  AND  RANDOM  MAIN  EFFECTS,  * 

*  RESPECTIVELY)  * 

*  Al  =  Bl*Br  * 

*  A2  =  B2*B2'  * 

*  DENOTE  THIS  MATRIX  BY  P  * 
*********************************************************. 

3 

%LVN51: 

Al      =  I(A)@(J(B,B,1)); 

A2      =  (J(A,A,1))@I(B); 

EIGEN  Ml  PI  Al; 

P2      =  PI  %STR(%'); 

C       =  P2*A2*P2  %STR(%'); 

EIGEN  M2  P3  C; 

P       =  P1*P3; 

P       =  P(2:RS,); 

CI      =  P*A1*P  %STR(%'); 

C2      =  P*A2*P  %STR(%'); 
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THEN 


THEN 


DO      I  =  1  TO  RS-1; 

IF  C1(I,I)  <  .00001  AND  C1(I,I)  >  -.00001 

C1(T,I)  =  0; 
IF  C2(I,I)  <  .00001  AND  C2(I,I)  >  -.00001 

C2(I,I)  =  0; 
END; 
P2  =  P(LOC(VECDIAG(C1)>0),); 
C3  =  CI  +  C2; 
DK  =  VECDIAG(C3); 


DO      I  =  1  TO  RS-1; 

IF  DK(I,)  =  0  THEN  DO; 
DG  =  DG I  I  I ; 
END; 
END; 

P4  =  P(DG,); 
P24  =  P2//P4; 


Bl 


=  I(A)@J(B,1,1); 


*  OBTAIN  THE  TRANSFORMATION  (3.93)  * 

L24     =  P24*K*P24  %STR(%'); 
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LA.M1  =  MAX(EIGVAL(L24)); 

NUl  =  B*(A-1); 

IVl  =  I(NUl); 

MATl  =  (LAM1*IV1  -  L24); 

EIGEN  Ml  M2  MATl; 

DO  I  =  1  TO  ^aJl ; 

IF  Ml (1,1)  <  .00001  AND  Ml (1,1)  >  -.00001  THEN  Ml (1,1)  =  0; 

M1(I,1)  =  SQRT(M1(I,M1)); 

END; 

MMl  =  DIAG(Ml); 

MAT2  =  M2*MM1*M2  %STR(7o'); 

W  =(I(N)  -  JJ); 

EIGEN  WWl  WW2  W; 

HFl  =  IW2(  ,1  :NU1); 

Wl  =  P24*YVAR  +  MAT2*HF1  %   STR(%')  *  Y; 

*  OBTAIN  A  SOLUTION  FOR  THE  VECTOR  OF  FIXED  EFFECTS   * 

*  USING  THE  NORK'iiLIZED  EQUATIONS  * 

********  A**  ***;'«*****  A*  A********  ***********  ;V  ******  ****■**. 

X  =  P24*B1; 

GX  =  GINV(X  ^STR(%')*  X); 

GHAT  =  GX*X  %STR(%')  *  Wl; 

R  =1-10  0/ 
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0    1-10/ 
0   0    1-1; 
R  =    R(1:A-1,1:A); 

*-k-k****-k*-k*-k-kie-k-kJ<:*-k*-k-k*:k*-kJ(-k*-kk**-k-k-k-k-k-k*-k-k-k*-k-k-k-J(  ******* 

*  NONl    =    NUMERATOR   OF    THE    F    STATISTIC  * 
*******************************************************. 

9 

NONl  =  ((R*GHAT)  %STR(% ' )*INV( R*GX*R  %STR( %'))*( R*GHAT) )#/G; 

******************************************************* 

*  DETERMINE  THE  ERROR  SUM  OF  SQUARES  OF  THE  MODEL     * 
*******************************************************. 

SSE  =  Wl  %STR(%')*W1  -  (GHAT  %STR(%')  *  X  %STR(%')  *W1); 

******************************************************* 

*  TO  TEST  THE  FIXED  EFFECTS  OF  THE  MODEL  WE  USE  THE   * 

*  TEST  STATISTIC  FH   (3.106)  * 
******************************************************** 

5 

FH    =   N0N1#/(SSE///N2); 

******************************************************** 

*  II.   A  TEST  FOR  THE  RANDOM  MAIN  EFFECT  OF  THE  MODEL  * 
********************************************************* 


-191- 


Tl  =    (1#/SQRT(2)| |-1#/SQRT(2)| |o| |0); 

T2  =    (1#/SQRT(6)|  |l///SQRT(6)|  |-2#/SQRT(6)|  |0); 

T3  =    (1#/SQRT(12)| |l#/SQRT(12)| [ 1#/SQRT( 12) | | -3#/SQRT( 12) ) 

T4  =   T1//T2//T3; 

T  =   T4(1:E-1,1:B); 

CT  =    I(A)(3T; 

*      OBTAIN   THE    TRAxNSFORMATION    (3.79)  * 

**************************************** ***************. 

ZT  =    CT*YVAR; 

CTA2  =   CT*A2*CT   %STR(7o'); 

EIGEN   MM    PT   CTA2; 

LIT  =    PT   %STR(%')    *   ZT; 

NU2  =    A*(B-1); 

HT  =  WW2( ,1:NU2); 

LT      =  PT  %STR(%')  *  CT*K*  CT  %STR(%')  *  PT; 
L2      =  MAX(EIGVAL(LT)); 
MAT3     =  (L2*I(NU2)  -  LT); 
EIGEN  Ml  M2  MAT3; 
DO  I    =  1  TO  NU2; 

IF  M1(I,1)  <  .00001  AND  M1(I,1)  >  -.00001  THEN  M1(I,1)  =  0; 
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M1(I,1)    =    SQRT(M1(I,1)); 

END; 
MMl  =    DIAG(Ml); 

MAT4  =  M2*M111*M2    %STR(%'); 

WT  =    UT  +  MAT4*HT   %STR(%')    *   Y; 

** -;c  A**  ********  ^jkjic*********************  A  **************** 

*  OBTAIN  THE  NUMERATOR  OF  THE  TEST  STATISTIC  * 

*******************************************************. 

i 

WTi     =  WT(1:B-1); 

QTB     =  (WTI  %STR(%')  *  WT1)#/N1; 

******************************************************* 

*  OBTAIN  THE  DENOMINATOR  OF  THE  TEST  STATISTIC        * 

*******************************************************. 

> 

WT2     =  WT(1:B,); 

QTAB    =  (WT2  %STR(%')  *  WT2)#/D1; 

******************************************************* 

*  TO  TEST  THE  FIXED  EFFECTS  OF  THE  MODEL  WE  USE      * 

*  THE  TEST  STATISTIC  FTl  (3.84)  * 
*******************************************************. 

FTl      =  QTB#/QTAB; 
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********  A  ******* -;c  ******  A*****)!c*A*AA*A->*****-A-5'<*  A- ******** 

*  III.   A  TEST  FOR  THE  RANDOM  INTERACTION  EFFECT  OF  * 

*  THE  MODEL  * 
*******************************************************. 

HT2     =  WW2( ,NU2+1:N-RS); 

QT2  =    (Y    %STR(%')*KT2*HT2    %STR(%  '  )*Y)  f//D2; 

FT2     =  QTAB#/QT2; 

ALL     =  FT2| |di| |d2|  JFTlj |ni| |fh| |g| |n2; 

OUTPUT  ALL  OUT  =  NEW(RENAiME  =  (COLl  =  FT2  C0L2  =  Dl  C0L3  =  D2 

C0L4  =  FTl  C0L5  =  Nl  C0L6  =  FH 
C0L7  =  G   COLS  =  N2)); 
DATA  ALL; 

SET  NEW; 

PFT2  =  1  -  PR0BF(FT2,D1,D2); 

PFTl  =  1  -  PR0BF(FT1,N1,D1); 

PFti   =  1  -  PR0BF(FH,G,N2); 
PROC  PRINT; 

VAR  FT2  01  D2  PFT2  FTl  Nl  PFTl  FH  G  N2  PFH; 
****************************************************************** 

*  PFT2  =  power  for  the  Exact  Test  of  the  Interaction  Effect.    * 

*  PFTl  =  power  for  the  Exact  Test  of  the  Random  Main  Effect.    * 

*  PFH   =  power  for  the  Exact  Test  of  the  Fixed  Main  Effect.     * 
*****************************************************************. 


APPENDIX  G 
IMHOF  COMPUTER  PR0GRA>1 

********  A  ********************  A*************  *****>ieA*AAAA*A*)i(A)!c***** 

*  PROCEDURE  FOR  COMPUTING  THE  POWERS  OF  THE  APPROXIMATE  TEST  * 

1.   OBTAIN  CRITICAL  VALUES  FROM  MONTE  CARLO  SIMULATION  * 

*  2.   USING  THESE  CRITICAL  VALUES  WE  APPLY  THE  PROGRAi-I  * 

*  IN  THIS  APPENDIX  (SEE  KOERTS  AND  ABRAHAMSE  (1969)).  * 

*  D  =  VECTOR  CONTAINING  THE  POSITIVE  EIGENVALUES  OF  THE  MATRIX  * 

*  ASSOCIATED  WITH  THE  QUADRATIC  FORM  INVOLVED  IN  COMPUTING  * 

*  THE  POWER.  * 

*  A 

*  MULT  =  VECTOR  CONTAINING  THE  MULTIPLICITIES  OF  THE  ABOVE  * 

*  EIGENVALUES.  * 

*  * 

*  DELTA  =  VECTOR  CONTAINING  THE  CORRESPONDING  NONCENTRALITY  * 

*  PARAMETERS.  * 

*******************************************;![  ********  AA***V^**A*^itVi. 

PROC  MATRIX; 

FETCH  MAT  DATA  =  NEW2(KEEP  =  D  DELTA  MULT); 

NR  =  NROW(MAT); 

D  =  MAT(,1); 
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DELTA  =  MAT( ,2); 

MULT  =  MAT( ,3); 

XKRIT  =  0; 

EPSl  =  .00001;EPS2  =  .00001; 

XK  =  0;SLAM  =  0;  SDELT  =  0; 

DO  I  =  1  TO  NR; 

XX  =  XK  +  0.5*MULT(I,); 

SLAM  =  SLAM  +  0. 5*MULT(I , )*L0G( ABS(D( I , ) ) ) ; 

SDELT  =  SDELT  +  0. 5*DELTA( I , ) ; 

END; 

UB  =  EXP(-(LOG(EPSl*XK)+1.14472989+(SLAM+SDELT))#/XK): 
LL1:SUM  =  0; 
no  I  =  1  TO  NR; 

DD  =  (D(I,)*UB)**2; 

SUM  =  SUM  +  DELTA(I,)*DD#/(1+DD); 

END; 

SUM  =  0.5*SUM; 

TU  =  EXP(1.3372989+L0G(XK)+(SLAM+SUM)+XK*L0G(UB)); 

CHI  =  1#/TU-EPS1; 

IF  CHI  <=  THEN  GOTO  LL20; 

UB  =    UB  +    5?>/XK; 

GOTO   LLl; 
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LL10:U  =  U; 

IF  U  <=  0  THEN  GOTO  LL15; 
TETA  =  0; 
RHO  =  1; 
SUM  =  0; 
DO  I  =  1  TO  NR; 
CI  =  D(I,)*U; 
C2  =  1+C1**2; 

TETA  =  TETA-H1ULT(I,)*ATAN(C1)+DELTA(I,)*C1#/C2; 
SUI-l  =  SUM  +  DELTA(I,)*C1**2///C2; 
RHO  =  RHO*(C2##(.25*MULT(I,))); 
END; 
TETA  =  0.5*(TETA-XKRIT*U); 
RHO  =  RHO*EXP(0.5*SUM); 
FBL  =  (SIN(TETA))'//(RHO*U); 
GOTO  LL18; 
LL15:    FBL  =  0; 

DO  I  =  1  TO  NR; 

FBL  =  FBL  +  D(I,)*(MULT(I,)+DELTA(r,)); 
END; 
FBL  =  0.5*(FBL-XKRIT); 
LL18:   IF  KSKIP  =  1  THEN  GOTO  LL21 
IF  KSKIP  =  2  THEN  GOTO  LL22; 
IF  KSKIP  =  3  THEN  GOTO  LL23; 
IF  KSKIP  =  4  THEN  GOTO  LL24: 
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IF  KSKIP  =  5  THEN  GOTO  LL25; 
LL21:  OU  =  1; RETURN; 
LL22:  OU  =  2; RETURN; 
LL23:  OU  =  3; RETURN; 
LL24:  OU  =  4;RETUR.N; 
LL2  5:  OU  =  5; RETURN; 
LL20:   RANGE  =  UB; 

MH  =  1; 

U  =  RANGE*0.5; 

KSKIP  =  1; 

LINK  LLIO; 

SUMK  =  FBL*RANGE*2///3; 

U  =  0; 

KSKIP  =  2; 

LINK  LLIO; 

VINT2  =  SUMK+FBL*RANGE#/6; 

U  =  UB; 

KSKIP  =  3; 

LINK  LLIO; 

VINT2  =  VINT2+FBL*RANGE#/6; 

FD  =  0.5  +  (-.3183*VINT2); 

DO  NIT  =  1  TO  14; 
FDl  =  FD; 

VINT2  =  (VINT2+(-SUMK*0.5))*0.5; 
MH  =  2*MH; 
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STEP    =    RANGE#/MH; 

U   =   STEP*0.5; 

KSKIP   =   4; 

LINK   LLIO; 

SUMK   =    FBL; 

DO    K   =    2    TO    MH; 

U  =    U  +   STEP; 

KSKIP  =    5; 

LINK   LLIO; 

SUMK  =    SUMK   +   FBL; 

END; 

SUMK   =   SUMK*STEP*2#/3; 

VINT2  =  VINT2  +  SUMK; 

FD  =  0.5+(-.318309886*VINT2); 

HH  =  (NIT  -  3); 

IF   HH    <=   0   THEN   GOTO   LL28; 

FF   =    (ABS(FD1-FD)-EPS2); 

IF  FF  <0  THEN  GOTO  LL29; 
LL28:  TT  =  0; 

END; 
LL29:SS  =  0; 

OUTPUT    FD    OUT   =    NEW4(RENAME=(C0L1    =    TYPEl)); 

*  1    -    FD    =    POWER   OF    THE    TEST.  * 

A*****************!^**********^!!**********************  A  ************  . 
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